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vices such as NOS integrated circuits. The memory 
system is organized as a planar array with rows and 
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bits being selectively coupled to the address decoders of 
the memory devices for selecting a memory element 
within each enabled memory device. 
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it has been proposed to skew, rotate, and otherwise 
MEMORY SYSTEM process the photographs retrieved to provide a realistic 

simulation of attitude and/or position changes between 

The U.S. Government has rights in this invention photographs in the dara bank, thereby minimizing the 
under Navy Contract No. N00019-78-G-0392. 5 requirement for an impractical number of stored photo- 

This is a division of application Ser. No. 305, 741 .filed graphic images. Such processing of photographic im- 
Sept. 25, 1981, now U.S. Pat. No. 4,463,380. ages for real-time simulation, however, requires that the 

This invention relates to memory systems, and, more photographic images be converted to a data processing 
particularly, to a memory system suitable for use in format suitable for computer aided processing tech- 
image processing systems wherein information corre- 10 niques and, in the past, the large amounts of data re- 
sponding to a given region or geometric system is sys- quired for realistic, high resolution image reproduction, 
tematically recorded and stored in a data bank and then the extremely complex processing techniques entailed, 
partially retrieved and processed for reproducing im- and the processing speeds required for providing 30- 
ages corresponding to selected portions of the geomet- second/frame reproduction have simply not been com- 
ric system. 15 patible. 

Image processing systems have been proposed for It is an object of the present invention to provide an 
permitting controllable display of images correspond- improved memory system. 

ing to portions of a quantity of pre-recorded visual or It is another object of the present invention to pro- 
geometric information. In such processing systems it vide an image processing system in which a data bank of 
has been proposed to provide reproduction of visual 20 high resolution images corresponding to known orien- 
image corresponding to portions of a geographical area, tations within a given geometric system is processed to 
building interior, or the like, but no system has been permit retrieval of portions of the images appropriate 
devised in which images are reproduced in simulated for simulating a portion of the geometric system, 
real time with acceptable levels of realism. A primary A further object is to provide such a system in which 
application of-the preserit„inventi_on is in conjunction 25 retrieval of the images is effected sequentially in re- 
with a visual display for flight simulator employed in sponse to inputs for simulating movement through the 
pilot training, and .the exemplary embodiment disclosed geometric system. 

relates to such. an application. It will be understood, A still further object is to provide such a system in 
however, that the system is also useful for various oiher, which the high resolution images are derived from 
applications such as the visual simulation of building 30 optically recorded images of a geometrical area and in 
interiors, city streets, factory interiors, and for various which the retrieval and display of the images corre- 
industrial applications such as computer aided design of sponds to simulated movement through the area, in 
geometric structures. response to commands from an operator, and in which 

Flight simulator systems employed for pilot training a real-time visual display is provided for simulating 
have in the past employed visual displays of only lim- 35 movement along the path input by the operator, 
ited capacity. Such systems have been incapable of A still further objective is to provide a visual flight 
reproducing wide angle views corresponding to a multi- simulation system having such a controlled data base 
plicity of simulated flight positions within a geographi- and operable for reproducing high definition, real-time 
cal area. A flight simulator capable of reproducing real- images of multiple, adjacent views of a given scene 
istic visual images corresponding to all possible scenes 40 along different vectors from a simulated cockpit, 
which could be viewed from an aircraft flying through Yet another object is to provide such a system opera- 
a given geographical area must be capable of displaying ble to process optically reproduced images derived 
scenes which would be viewed from the craft along a from multiple views taken along multiple axes of a geo- 
substantial variety of flight paths and conditions, e.g., metric system, and to integrate the multiple images into 
along any azimuth and at any potential selected attitude 45 a single overall scene representative of a wide angle, 
(yaw, pitch, roll), at any altitude, and within a realistic hemispherical view of the overall scene, 
range of velocities. If the images are to be displayed in A still further object is to provide a display process- 
simulated "real time' 1 corresponding to an inputed flight ing unit capable of selecting, processing, and displaying 
path selected by the pilot trainee, it will be apparent to appropriate portions of a hemispherical image as re- 
those versed in the art that rapid processing of large 50 quired to simulate a view of a portion of the overall 
amounts of data will be required. Largely because of scene at and along a particular axis, 
these factors, the image processing systems which have In the drawing: 

been proposed in the past have not been capable of FIG. 1 is a perspective, partially diagrammatic view 

processing the large amounts of data entailed, with of the visual display portion of the system; 

sufficient speed. 55 FIG. 2 is a diagrammatic representation of the image 

Whereas multiple photographs of high resolution processing and display portion of the system; 
taken at various positions within a geographical area, as FIG. 3 is a partially diagrammatic, cross-sectional 
from an aircraft traveling along a known pattern of view of the lens system employed in the aerial camera; 
flight paths, may include large amounts of visual infor- FIG. 4 is a diagrammatic representation of the image 
mation about the area, mere sequential retrieval of such 60 processing system; 

unprocessed photographs does not accurately simulate FIG. 5 is a representation of the fields of view visible 
a flight path selected by the simulator operator unless from the cockpit; 

the selected flight path happens, by an improbable coin- FIG. 6 is a representation of a film frame having 
cidence, to correspond exactly with the flight path of multiple view segments. 

the aircraft from which the pictures were taken. Be- 65 FIGS. 7(a), 7(6), and 7(c) are plan, side, and endwise 
cause it would be impractical to store the multiplicity of representations of the film transport unit; 
photographs required to show all portions of an area FIG. 8 is a graphical representaion of the timing 
from all possible altitudes, attitudes and X-Y positions, cycle of the processing system; 
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FIGS. 9(o), 9(6), and 9(c) are, respectively, diagram- FIO. 35 is a diagrammatic representation of the cell 

matic representations of the filter plane, the partially memory address and read systems; 

spherical scene field of view, and the pseudo image FIO. 36 is a diagrammatic representation of the cell 

plane representing the integrated images employed for memory section interfaces; 

processing. 3 37 •* * teble e^P^^ representation of the 

FIG. 10 is a representation of the scanning pattern luminance array memory module addressing pattern; 

over a Mm frame generated by the raster generator, FIG. 38 is a graphical representation of the luminance 

FIG. 11 is a schematic, partially diagrammatic repre- array memory module interleaving pattern; 

sentation of the raster generator portion of the image FIG. 39 is a diagrammatic representation of a cell 

recording system; 10 memory module; 

FIG. 12 1 a view, similar to FIG. 11. of the uZ* HG. 40 is a diagrammatic representation or func 

procetsing portion of the image recording system; *»* block diagram dlustratmg the cell memory input- 

FIG. 13 is a view, similar to FIGS. 11 and U, show- /output interfacing; 
ingtheviewiden^ l5 

^HG^ is a view, similar to FIGS. 11-13. of the ™J- « » ? diagrammatic representation of the ad- 

image scanning apparatus and associated components of ™ tt dfagrammatic representation of the lumi- 

the image recording system; . . £ . 

FIG. 14A is a representation showing the positional £ diagrammatic representation of the chro- 

interrelationship of the recording system circuit por- input ^ buses; 

tiow of FIGS. 11-17; FIG. 45 is a diagrammatic representation of the mod- 

FIG. 15 is a view, similar to FIGS 11-14, showing ^ d , fOUte interfaccs; 

the scene storage system and associated components of HG ^ - 3 ft diagrammatic representation of the cell 

the image recording system; 2J memory i um inan C e array output interfaces; 

FIG. 16 is a view, similar to FIGS. 11-15, showing piG 4? fa ft diagramrnat i c representation of the chro- 

the luminance and color correction sections of the ninwee array output intefaces; 

image recording system; PIQ 43 ^ a diagrammatic representation of the cell 

FIG. 17 is a view, similar to FIGS. 11-16, showing meTOO ry and interpolative circuit; 
the start address generator section, the Y, I, Q - to Red, ^ pj G 49 ^ a graphical representation of the cell mem- 
Green, Blue conversion section, analog processing sec- ory modc timing; 

tion, and associated components of the image recording pjo 50 is a graphical representation of the cell mem- 
section and showing the frame buffer window tuning ory writc moc j c timing; 

section and associated components, of the image re- pjQ. 51 is a diagrammatic representation of the data 
cording section; 35 output circuit from the cell memory section; 

FIG. 19 is a diagrammatic representation of a Simula- pjQ $2v&a. diagrammatic representation of the cell 

tor computer and control system; memory output data circuit; 

FIG. 20 is a diagrammatic representation of the video pjo. 53 is a graphical representation of the cell mem- 
storage system; ory PWB write mode input timing. 

FIG. 21 is a diagrammatic representation of the video 40 p 0 r clarity of description, a preliminary summary of 

digitizer system; the major features of the recording and display portions 

FIG. 22 is a diagrammatic representation of the scene G f a preferred embodiment of the system is now pro- 
storage system; vided, after which individual portions of the system will 

FIG. 23 is a diagrammatic representation of the cell be described in detail, 
processor system; 45 The disclosed embodiment of the system as an air- 

FIG. 24 is a diagrammatic representation of the input cra ft flight simulator may be termed an "out-the-win- 
interpolative circuit; FIG. 24A is a graphical represen- dow" real world visual scene display system, and pres- 
tation of the interpolator outputs; crably employs multiple video discs for storing in 

FIG. 25 is a diagrammatic representation of a typical NTSC TV format the visual information derived from 
one of the digitizer channels; 50 aerial photographs of a "gaming area,'* Le., the geo- 

FIG. 26 is a diagrammatic representation of the read graphical area through which a simulated flight may 

address generator circuit; occur. The use of video discs, or the other high capacity 

FIG. 27 is a graphical representation of the Hnes and storage media, as direct rapid access bulk storage de- 
regions typically resolved by the display raster; vices is an important factor in the system, which em- 

FIG. 28 is a diagrammatic representation of the out- 55 ploys a series of discrete aerial photographs of the gam- 
put processor circuit of one cell processor system; ming area terrain as an initial data source. Each picture 

FIG. 29 is a« diagrammatic representation of the haze is electronically scanned and converted to time-base 

and sky generation circuit; video data, which is processed into a digital television 

FIG. 30 is a diagrammatic representation of the trans- signal, and recorded and stored on video discs. When 
verse filter circuit; 60 needed for display, the data are retrieved, electronically 

FIG. 31 is a diagrammatic representation of the longi- processed and manipulated to display the correct pcr- 

tudinal digital filter circuit; spective view of terrain relative to the position and 

FIG. 32 is a diagrammatic representation of the video attitude of the simulated aircraft. The data base for the 

clamping circuit of the time base corrector; multichannel out-the-cockpit display is thus initially 

FIG. 33 is a diagrammatic representation of the 65 recorded on color film, 

chroma decoder section; The technical requirements for deriving real time 

FIG. 34 is a diagrammatic representation of the win- visual images with multiple fields of view from a data 

dow mapping coordinate system; bank comprising multiple images or scenes are substan- 
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tial, as has been briefly discussed above. To permit 
real-time processing of visual information, it is advanta- 
geous to store the information electronically in multiple 
storage media, e.g., in multiple video tapes or disc re- 
cordings. Source data derived from high resolution 
photographs is preferred for realism, but the need for 
processing of the information necessitates its conversion 
into electrically encoded form. Technical difficulties 
are manifold because of the requirements for rapid re- 
call of information in usable form to permit a nominal 10 
thirty frames per second reproduction of images for 
simulating moving scenes corresponding in real time to 
the path elected by the operator and, at the same time, 
providing the requisite massive storage of information 
contained in photographic images of the size and resolu- 15 
tion required for scene realism. These techniques entail 
the selective retrieving, processing, and coherent dis- 
play of visual images in color, suitably on multiple dis- 
plays positioned adjacent the operator'seat or "cock- 
pit," as shown in FIG. 1, at orientations corresponding 20 
to respective views seen through the cockpit windows, 
in a realistic, real time manner and corresponding to the 
"flight position" information input by computer or the 
operator. Such information includes the "real-time 1 * 
simulated location of the simulated aircraft or vehicle, 25 
its velocity, azimuth, and attitude. The transition from 
information derived from one photograph, appropriate 
for a given set of inputs, to that appropriate for the next 
time sequence is also entailed. The display system in- 
cludes a plurality of video displays e.g., TV projectors 30 
suitably directioned for projecting images on screens 12 
positioned adjacent respective windows of the cockpit 
simulator 13. As seen in FIG. 5, views visible through 
the respective windows of the cockpit simulator 13 are 
approximately "distorted 1 * and selected from a quasi 35 
spherical overall field of view providing an appropriate 
perspective from the respective windows, as will be 
more fully understood from the description hereinbe- 
low. 

As an overview of the visual on-line playback system, 40 
and with reference to FIG. 2, the playback system con- 
sists of a video storage system 14 which includes multi- 
ple video discs suitably played by disc playback units, 
not shown, having rapid frame selection, such as those 
manufactured as DiscoVisionModel 720 by the Disco 45 
Vision Corporation. The discs contain the entire photo- 
graphic data base, i.e., photographic images recorded 
sequentially and systematically throughout the gaming 
area. The video storage system 10 includes control 
interfacing with the control computer 19 for feeding 50 
desired portions of the information to the remainder of 
the system. As suggested above, massive amount of 
information is thus stored on the multiple video discs in 
standard NTSC television format, and it is not readily 
processed by electronic circuitry. Such processing is 55 
required, as will be understood from the description 
below, when coordinating the multiple inputs, derived 
originally from the pilots 1 controls, to the programmed 
and displayed images. As will also be understood from 
the description below, an important aspect of the pres* 60 
ent invention is its capability of selecting appropriate 
portions of the stored visual information for rapid pro- 
cessing to provide real-time playback, thus making 
compatible the requirements for both storage of re- 
quired amounts of visual information corresponding to 65 
the geographical 'gaming area," and at the same time, 
selective rapid processing of portions of the information 
as required for simulated real-time display. 



Under control of a general purpose computer 19, 
suitably a Harris model 800 series, information from up 
to three of the video disc playback units, which infor- 
mation corresponds to the photographic images, is si- 
multaneously selected for retrieval. The playback units 
are synchronized under the control of the computer 19, 
and the disc units are actuated to play back information 
in National Television Standard Commission (NTSC) 
video format corresponding to the appropriate photo- 
graphic image. The information is entered into a video 
digitizer system 195, FIG. 2, which, as suggested above, 
operates to take the analog information and perform 
color correction and time base correction functions to 
"fine tune*' the information derived from more than one 
playback channel, for synchronizing it into a consistent 
image, and then converts the information into digital 
format. The requirement for digitizing the analog infor- 
mation relates to the need for permitting high speed 
digital processing techniques to be applied to the se- 
lected photographic data vase extracted from the over- 
all data base stored in the digital playback discs. This 
information is then stored in a scene storage system 28, 
which comprises a large capacity storage memory. 
Since up to three television frames of information, each 
comprising one sector of information from a photo- 
graph frame, are read at one time under control of the 
computer 19, the video digitizer system 195 and video 
scene storage system 28 select information segments 
from up to three of the discs, corresponding to the 
particular stored photographic information appropriate 
for the current position of the simulated aircraft, and 
feed this information into scene storage memory seg- 
ments. Each segment of the scene storage system 28 
stores in digital form information corresponding to a 
portion of one photographic image. The scene storage 
system 28 serially records information pertaining to one 
or more scenes, i.e., relating to and capable of reproduc- 
ing part or all of one or more of the photographic im- 
ages recorded in the original photographic data bank. 

Each segment of information corresponding to one 
photographic scene corresponds to a portion, e.g., a 
strip of a semi-spherical reproduction representing a 
fish-eye view or photograph. The scene storage system 
28, under computer control, next reads and routes the 
appropriate portions of the information to the plurality 
of cell processor systems 312(a), (b), (c), (</). which 
portions correspond to the portions of the image to be 
projected from the image displays fed by respective w 
cell processor systems which further process the infor- 
mation into a format suitable for driving the image 
displays, FIG. 1, of the visual display system. 

Referring to FIG. 3, the lens system of the multi-lens 
aerial camera employed for producing the composite 
mosaic photograph for use in the recording system is 
shown in partially diagrammatic cross section. The lens 
system 36 consists of a wide angle center lens 37 nor- 
mally directioned vertically downwardly in use, and six 
oblique lenses 39(a), (b\ (c) t (d), (e) and (/), directioned 
along diagonal axes approximately 28 degrees from 
horizontal and angularly spaced, at approximately 60 
degree intervals, concentrically around the center lens 
38. The camera body itself, not shown, is a conventional 
roll-film aerial camera body suitably having a 9iX 91- 
inch film field. 

The camera is hexagon configured with six shutters 
and lenses spaced around the center shutter and lens for 
a simultaneous exposure of the 9 J inch wide film for a 
slightly greater than hemispherical field of view. Each 
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lens field of view (fov) overlaps the other and the entire tions of the overall scene by an operator. The corrected 
composite wide angle fov encompasses 360% to 16* signal is then fed through an overlap memory circuit 
above the horizon. The camera is mounted in the hull of and a digital-to-analog encoder circuit 32, and b subse- 
an aircraft and is suitably capable of making exposures quently recorded in NTSC format by the video tope 
at rates up to one per second under control of an inter- 5 recorders 16. 

valometer remotely mounted in the aircraft. Each video channel has the capability of being con- 

The camera lenses are arranged to produce mosaic nected to any one of 16 players. All three channels 
photographs, as represented in FIG. 6, upon a film operate independently of one another, under control of 
frame 40 which includes photograph mosaics taken by the master computer 19. Each video input channel is 
each of the respective lenses, including a circular center 10 equipped with a digital Time Base Corrector (TBC). 
view 41, and six oblique mosic views 42 {a), (b) t (c), and The purpose of these Time Base Correctors is to time- 
to. The film frame 40 transparency is positioned in a base-correct and synchronize the outputs of the video- 
film transport unit 47 as shown in more detail in FIG. 7, disc players. All three TBCs receive a common refer- 
and during record processing is positioned adjacent a ence signal. The advanced reference output of one of 
Hying spot scanning cathode ray Tube 17. Referring now 1 5 the TBCs is used to rotationally synchronize the video- 
to FIG. 4, the record processor system 15 serves, in disc players. Each video input channel is equipped with 
essence, to scan the mosaic photograph film frame 40 an automatic color corrector which utilizes a reference 
produced by the multi-lens camera and provide usable signal to correct the chroma phase, chroma gain, master 
data employable for forrning an electronically simu- gain, and setup levels of the TBC output. This reference 
lated, single composition image from a film frame 40. 20 signal is generated during the data base generation pro- 
The information is then stored in storage media, which cess and accompanies the video data throughout the 
suitably comprises the video tape recorders 16, NTSC recording and videodisc mastering process, 
format. For compactness of storage and rapid access To provide a functional overview of the system, the 
during playback, the information is then transferred, in following description is now provided as a more de- 
analog NTSC form, from the topes into a plurality of 25 tailed procedural summary prior to a consideration of 
video playback discs, the component elements in greater detail. As described 

Scanning the film frame 40 in the film transport 47 is above, the system converts discrete photographs into a 
accomplished by means of the cathode ray tube 17 in time base electronically manipulated video pilot per- 
rcsponse to signals received from the raster generator spective for a real world display. Discrete photographs 
18 which, under control of the visual system computer 30 are made of the gaming area at various altitude spac- 
19, generates a pattern of high resolution scanning dots ings. A Glra edit system is used to identify and/or verify 
in accordance with a predetermined pattern, to be de- camera eyepoint locations, to catalog each photo with a 
scribed, correlated with the seven view film frame pat- unique number, and provide the ordering of the frame 
tern 40, and which are focused by lens 48 within the film for disc mastering. 

transport unit upon the mosaic film frame 40. The film 35 The flying spot scanner device breaks the photograph 
employed is suitably a negative transparency. The film down into a mosaic of thousands of dots of varying 
transport circuit 47, as shown in FIGS. 7(a), 7(6), and intensities or voltages, when collected on the photomul- 
7(c), includes a supply roller 48 aligned with a corre- tiplier tubes. These voltages are fed into the video pro- 
spending take-up roller 49, for translating the film cessor system for processing to convert the data to a 
frames 40 across a film tray or holder 50 which is 40 format suitable for video tape storage and subsequent 
adapted to be positioned over the views while scanned transfer to the video discs. The use of the video discs as 
by the CRT. Oppositely torqued servo motors 51 (o), 51 a direct rapid access bulk storage device provides the 
(6), maintain tension on the film, and "X" and "Y" means to interpolate and traverse the original photo- 
stepping motors 52 (a), 52 (6), respectively, drive corre- graph set from any altitude and heading within the 
spending worm screws for positioning the film holder 45 original photographic corridor. 

in the "X" & "Y" axes relative to the cathode ray scan- To create a realistic display for the simulator pilot, 
ning tube. As a white scanning dot is scanned across the the original scene data is processed and manipulated for 
film 40, color separation optics filtering and lens array proper perspective. Processing steps provide the proper 
system 24 receive the scanned information and converts viewpoint and perspective compensation using dynamic 
visible light patterns into red, blue, and green light 50 magnification and interpolation techniques. Only a por- 
infonnation separated and conducted along respective tion of the overall scene is displayed at any one time, 
axes, which discrete color signals are respectively The pilot has freedom of route and altitude within the 
sensed by first, second, and third photo multiplier tubes gaming area. Transition from one photograph to an- 
25 (a), 25 {t>) t 25 (c) (FIG. 1). Subsequent, the separate other is smooth, and the perspective view is computed 
colors are channeled through separate processing chan- 55 30 times a second and moves smoothly in response to 
nels, and the channels are fed through an analog-to-digi- changes in position of the simulated aircraft as it flies 
tal conversion circuit 27, which then feeds digital sig- through the area of the photographs, 
nals to a scene storage system 28, comprising a large The visual display includes a data base with high and 
capacity, digital semiconductor memory. The scene low level navigation routes, and the display is a daylight 
storage system, under computer control and in response 60 scene in color with distinguishable scenery or geogra- 
to the signal generated by the raster generator 18, phy. The total gaming area is, for example, approxi- 
merges the signal generated by the raster generator 18, matcly 1 ,500 square miles and extends from a few feet to 
merges the multiple mosaic views into a single mosaic 22,500 feet altitude in portions thereof, 
image scene for later use by the playback unit. The The playback system is preferably equippd with six- 
information stored in the scene storage system 28 is next 65 teen on-line video disc players, any three of which are 
processed by a color corrector circuit 29 under opera- capable of being read simultaneously. Each video disc 
tor control to correct color distortions, and a frame holds approximately 400 scenes for a total on-line capa- 
buffer circuit 30 permits monitoring of particular por- bility of approximately 6,400 scenes. Laser-read video 
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discs hold the one-line data base of pictures, providing the edge matching and displayed scene geometry er- 

random access to the scene of interest. rors. 

A digital picture processor is provided for converting Each display's imagery is provided by a cell proces- 
video information accessed from the video discs into sor assembly 312(c), {b), (c), (</) which provides the 875 
display format. It consists of a Video Digitizer System 5 line color video signals. The cell processor assembly 
195, Scene Storage System 28 and Cell Processor Sys- 312 is capable of providing signals with similar elec- 
tem 312(a), (b\ (c), and (rf) as shown in FIG. 2. The tronic bandpass to any display system with wide range 
Video Storage System (VSS) 14 is made up of the six- fields of view and varied geometric shapes. The aerial 
teen videodisc units. The discs are under control of the camera, in exposing each frame processes, several fidu- 
computer 19 and are capable of randomly accessing any 10 cial marks recorded on portions of each film plate, as 
of the stored scenes. The Video Storage System 14 shown in FIG. 6, for permitting subsequent photogram- 
feeds video from the selected disc units to the Video metric analysis, for calibration of the scanning system 
Digitizer System (VDS) 195. The VDS 195 has three relative to the film, and for positioning in the film trans- 
independent channels, each of which accepts the analog P° rt tne respective mosaic views during subsequent 
video, digitizes, standardizes, and niters it, then digitally 15 processing. In addition, a numerical scene identification 
multiplexes it into a form suitable for the Scene Storage number is recorded on each frame. 
System (SSS) 28 which provides fast storage of part or w,th ns P^ ct now to the circuitry and apparatus for 
all of one or more color scenes. Its purpose is to buffer * e «™ *°» 85 discussed above, the pri- 
the scene currently being displayed between the rela- mar y P^W** of the record system is to generate contin- 
tively slow discs and the fast cell memories. The Scene 20 uous ^ m * geometry matched pictures from non- 
Storage System 28 feeds the cell processors 312(a), (6), ^grated raw photographic mosaic views, and to re- 
(c), {d) through a multichannel bus system. The Cell f° r , d ±cm ™ Y" 1 ^ ^ m "pecificsequence for even- 
Processor System (CPS) 312 includes a respective cell WI * thc P 1 '^ ?" ° L f 

processor 312(a), (b), (c), (d) for each windowof th end „ ° f ***** 15 f * he f ? rc ™ t,y deterauncs 

display w w w x / 25 the coordmates of points m the film plane, using the 

Each cell processor 312(a). (6). (c). (0 stores the f ™ \ he ?f *° in * «,» Pro- 
portion of the scene that its display w ndow is operating P" . p, "£ ™ e ««"!»«*>•« * P**" «* 

* c *u- . _j . . „ ^ --5 herein, refers to a two-dimensional coordinate system 

in. From this stored scene data, the cell processor 312 wfch ^ { ^ frame plane 

generates a raster-scanned image, which contains the ^ t0 ^ lane ^erttes M intcgr ated, quasi- 

effects necessary to display tte desired color view on herical MfW| * ^ ^ term ,. fll * fram ^ 

the screen^ These effects mclude rotation, perspective, fers to the e fllm ^ nominally a nine-inch 

eyepoint shift magnification, sky generation, and haze ^ ofthe orig i„aJ transparency in which seven 

generation. All the systems mentioned 1 above are con- m rccorded . tenn » view " refers to the mo _ 

trolled by the video computer 15 which blinked to the 33 ^ 8U b-areas of the film frame located in each of seven 

host computer 512, as will be understood from the dc locations cxposed by a ^ e lcns of the ^ 
scnption to follow, .term "scene" refers to the data from all of the views on 

An important aspect of the data processing system is one m m frame whcn integrated on the pseudo-film 

its progression from systems of large storage capacity planCt ^ ^ . w » refere tQ the nion of the 

and relatively long access tunes to succeedingly faster « ^ that te ^ored on one NTSC frame or scene mem- 

but smaller devices, achieving a maximum rate at the ory or vidco onc disc trac|c Scria , data ^ s|orcd Qn 

d.splays of one newly computed picture every 1/30 magn etic tape is generated by scaning the pseudo-film 

second for each display channel and for all simulated pIanc 40 in thc portion Xfdirection to form scene lines 

flight conditions within the data base envelope. Data amJ in ^ positive Y^direction to form sequential scene 

base and picture processor sizes are minimized through 45 lines . The term "segment" refers to that portion of a 

judicious encoding of picture information, and through scan line which, after conpression, will be stored 

exploitation of the redundancies existing in the pictorial „ ^ j^jsq ^ Une timc together with the line sync 

terrain being processed. format and other data. 

For the pilot's visual display system, any rastering Referring to FIG. 9A, 9 perspective, diagrammatic 

display device is usable. A multiple channel rear TV 50 view ofthe actual film plane is shown, and the raster 

projection system is suitable. As shown in FIG. 1, a scanning system is operative to convert this information 

typical projection system consists of six rear projection mto a pseudo-film plane, as shown in FIG. 9C, in which 

screens 12 arranged to collectively provide the pilots are stored all information for reproducing a pseudo-film 

forward hemisphere field of view. The translucent rear image corresponding to the full scene field-of-view 

projector screen is designed to provide uniform bright- 55 shown in FIG. 9B. The reason for the implementation 

ness over each screen area. Each display screen 12 has 0 f a pseudo-film plane image in the memory of the sys- 

an associated TV projector 11 and folding mirrors ar- tern, is that, it is impractical for a single lens to fprm an 

ranged to provide the minimum overall system size. optical image having greater than hemispherical field of 

Each TV projector 11 is typically an 875 line color view with the resolution and with the short exposure 

projector providing color imagery over the wide dis- 60 time capability required. Referring to FIG. 9C, the 

play field of view with high display resolution. In the coordinates of a point in the pseudo-film plane are given 

display screen corners are located photodiode sensors by (Xf» Y/r). The coordinates of the corresponding 

that measure the position of projected targets (single points are denoted by (Kb Ye, and Ze), on a unit 

bright pixels surrounded by a small dark field). The sphere, and by (X5, Y5) in the coordinate plane of the 

positional error of these targets reflects the real time 65 individual film view. 

distortion and alignment errors of the display system The result of the transformation is to transform posi- 
and is interfaced in real time with the ceD processor tion scanning information relating to the "F* or pseudo- 
system to continuously correct these errors, toniinimize film frame coordinates [FIG. 9(a)] to **S" coordinates, 
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t.e., coordinates corresponding to the actual film frame. mally suited for one of the views 42(a), (b), (c), (</), (*) 

To accomplish this transformation, it is convienient to or (/), respectively, of the film sheets, and the central, 

conduct an intermediate transformation in which each hexagonal pattern 35G is employed for the center view 

given point in the pseudo-film frame is mapped to the 41. This partem of scanning was determined from the 

surface of a substantially hemispherical surface, FIG. 5 transformation equations just above and employing the 

9B, centered about the theoretical optical node point of circuitry discussed below. Referring now to FIG. 11, a 

the camera, followed by a perspective transformation p5 eudo-fUm coordinate generator circuit 60 includes 

leading to the actual film frame. In addition, a (2-Z 3 ) m t rcgistcrs 61(a y 61(fc)i wh ich receive computer 

transformation term is included to uiiiquclymap points m f ormat f OQ correspon ding to initial X coordinates and 

which arc >dose to and above the honzon, TTte need for l0 COO rdinateW and 62(j), 62(6) corresponding to 

this transformauon derives from the mward projection Jj» Y crordinate address andlelta Y information. 

of the spherical section above the horizon over the ten "J™ ^ * , . m nantxr 

degree section below the horizon which would cause The pseudo-film coordinate generator circuit .60 gener- 

double-valued mapping of the spherical surface onto a *tes a «™ " shown in FIG. 10. Xf is the fast direction 

plane for any simple projection mapping transforma- 15 and Yf is the slow scan direction. The computer 19 

tion. The (2-Ze) terra also provides a resolution— e- supplies the initial values Xo and Yq, and the step sizes 

qualizing mapping property such that the elevation delta X and delta Y. These values are scaled so that the 

angular metric on the sphere varies no more than two- complete scene given on each film frame lies within a 

to-one relative to the radial metric in the pseudo film 2x2 coordinate square reference system when mapped 

plane over the full field of view of interest, eg.; the 20 into the pseudo film. The scanning mapping circuit 

mapping transformation conserves the resolution pres- operates at a 10.7 MHz nominal frequency. The input 

ent in the film images. The mapping transformation registers 61(a), 61(6), 62(a), 62(6), are each 24-bit input 

implemented in the film scanning system applies the storage registers, each for receiving addresses as for 

following operations to every picture element position, respective point locations on the pseudo-film plane 

(Xf, Yf>, 25 generated by the computer 19. The initial X5 and Y5 

1. solution for pseudo film radial distance signals are fed to multiplex or selector circuits 63, 64, 

2 . the outputs of which are fed to respective latch circuits 

P-(Xf) +(Yft 54} The latches ensure that the signals are synchro* 

2. solution for Z E from the QUARTIC equation ™* JfR^Vf fT^^t ^ 

30 signals to adders 72, 73. The Xf latch is thus set to Xoat 

(z £ ) 4 -4{Z£) 3 +3(z£> 2 -4<Z£>+P-4=o the beginning of each raster line, and the Yf latch is 

increased by delta Y at the end of each raster line. Xfis 
for the solution interval 0 Ze 1 -2 and formation of the increased by delta X during each clock cycle, 
term uZ for that interval. An (Xf^+^f) 2 generator 75 is provided for squaring 

3. formation of the vector *5 adding the Xf and Yf values. Two multipliers in 

parallel, each connected to the combined "X" output 
<iiX & jiY & ( iZf)=(X/r. Y Ft ^Z £ ) through respective 16-bit buffer amplifiers, are ping- 

ponged to provide (Xf) 2 to achieve the required 10.7 

4. Transformation of the scannmg vector into a coor- MHz mc ^ oulputa m fcd into fl multiplexer 78 
dinate system having principal axes nominally aligned 40 which fa M [niQ m addef ^ the other input lo the 
with the selected camera film view orientation and adder being connected through multiplier 81 to receive 
including the geometric : effects of; ^ y rf , from , atch ^ fiufTers 

a. Camera lens ^^^^^ ***** «A, 8 2B, 82C are connected between the inputs of the 

b. Selected camera lens focal length * „ __ __ . . . - S~.,a~ ci™ 

c. Selected view orientation and position in the scan- 43 mul ^ 7 * 11 < « ^°TVl£X^? 
ner coordinate generator 60. When (Xf) 2 + \*Fr exceeds I , 

d. Film linear dimensional values and sytematic er- a value of 1 is outputted to produce a continuous func- 
rors tion corresponding to that portion of the pseudo film 

e. Scanner system linear and rotational calibration not containing scene data, and a CRT blanking signal is 
values and systematic errors. 50 generated, as will be more fully described herembelow. 

f. Attitude of the camera The outputs of the adder 80 are conducted through M R" 

g. Displacement of the camera from the desired pic- gate 83 to a circuit. The carry output lead 85 of the 
ture-taking point at the time the photograph was adder is also connected to the other side of the "R" 
exposed. gate, and to a latching circuit comprising first, second, 

5. Solution for the plane projective point 55 third and fourth delay producing latching circuits 86A, 

86B, 86C, and 86D. These latching circuits serve to 
m^Ye delay the carry bit signal to a degree corresponding to 

YS = — delays produced in the Ze circuit 84. The carry signal is 

generated when Xf (2) + Y/* 2) exceeds 1. The purpose of 
2^ 60 tne ^F circuit is to generate the solution of the equation 

** B Z£^)-4Z£^) + 3Z£< J >+4Z £ +P-4=0 

(k being a scaling j constant) trancfnrma for Z E , and to further form the term pZ E where 

Referring to FIG. 10, the typical pseudo transforma- c ' n <^ rr <: 1 <■» 

tion pattern is shown. « f ? °jf \ • , r~«h., for .hk 

Referring to FIG. 10, each of the trapezoidal enten- * d.rect closed formsolut.on is not feas.ble for this 

sions 35A. B. C, D. E and F, correspond to the scanning W*™ equation Z B . Therefore. Z E is solved off-ltne. 

patterns which have been determined in use to be opti- and a look-up table containing a piecewise linear ap- 
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proximation is created using first and second PROMs to multipliers 107, 110, and 104. Similarly, information 
for solving the equations. regarding Y/Kwhich is the same as fiYfis received from 

latching circuit 66 through multiple latches to multipli- 
z^»-4Z£f»+3Z^«+4z c +p-4=o ers 105 n2 ^ m Adder circuits n7 receives a 

^ e . M ^ „„ . vr »v „ m 5 inputs from multipliers 107, 108; adder circuit 118 re- 

Referring again to FIG. 11, the output XO>y+ YW F cdvcs • uts fr0 ™ K mu]li pijer n0 , 111; and adder circuit 
from the R gate 83 is fed through latching circuit 89 to n9 muIti licrs 104( 105f x re s pect ive latchng cir- 

? d f?? PR r° M ' ncraones *>' t 9 * cuiu.aiidtheomputsofwhichareaddedtoinfonnation 

PROM 90 contains tabular information regarding the „ ; . f w ■■ m j 1M 

. . - , i - ~ _ j - uuir received from multipliers 109, 112, and 106, respec- 

break point values of P versus uZe and is suitably of m -t . , , . . ' , , ' . . ^ 

5I2X 18 bits capacity. The second PROM 91 has tabu- 10 ^ ^■"^J U ^ " 

lar informauon regarding the corresponding slopes of " dde I circu,t * ™> *° receive mforma- 

the curve P versuT/iZ* and is suitably of a 512x9 tIon from multipliers 109, 112, and 106, respectively^ 

capacity. Information regarding the slope from PROM completing the matrix multiplication operation. The 

91 is conducted to multiplier 92 and simultaneously 15 ou 'P ut of represents jtY/r, the output of adder 

multiplied by information derived directly from the 125 represents and the output of adder 126 repre- 

latcb 89 regarding which is, again, X/^+Y/ 3 . The input t** 1 * M*£- In operation, the scan coordinates are ob- 

to latch 89 comprises an 18 bits p value, and it is divided by performing a projection operation according 

at latch 89 into a "9 most significant bits" signal which to equations. 

is fed to PROM 90 and a "9 least significant bits" signal M 

which is fed directly to multiplier 92. PROM 90 gives Y s =*iY £ (divided by) jtX £ 

the break point value, or approximate value of \lLe • _ ... . . * 

which is then fed through latch 93 and latch 94 to the *s=^Et*vtoec *y) »*e 

adder 95. The break point value of p is also fed into the implementation shown, the reciprocal of »X E 

9-bit mput to the PROM 91 which provides from its „ . . ^ , r . • r 

memory the local slope, which is then fed through mul- 25 » cv ?™ ic ? bv a WISC ^ .^P™™* 00 w,th , 

tiplier 92 and which, when multiplied by the leaslsignif- br ^ P™' values and slope stored in PROM circuits of 

icant 9 bits of P. provides the correction to the break a .^ ,c lo ° k "P/™<*™ evaluation circuit 129 which is 

point value which is fed into adder 95, and which when similar and analogous to the uZ* table lookup circuit 84 

thus added to the break point value gives the correct „ Previously described. Informauon regarding u.Y f is fed 

value of imZ* The signal uZfis then fed through latch- 30 ' rom **ter 134 through multiple latching circuits to a 

ing circuit 96 to a selector 100. Selector 100 has a sec- first multiplier 131 of the projection circuit. The second 

ond input which receives, when needed, a test input »P* of the multiples 13/is from the table lookup func- 

from the computer, and in normal operation, it merely Uon generator evaluation circuit 129, whose output is a 

passes the input from latching circuit 96. „ reciprocal of fiX E whereby the output of multiplier 131 

Referring to FIG. 9, coordinates (Y, & Z,) are ex- 35 is \ s which is the Y value of the scanner coordinates, 

pressed in a coordinate system which is centered on and The second multiplier 132 receives information regard- 
relative to the flying spot scanner/optics/film handler ing p-Z^from the adder circuit 125 along with informa- 

coordinate system. Each view of the film frame is me- tion provided from the table lookup function evaluation 

chanically positioned so as to nominally center on the circuit 129, and its output represents Z$ of the scanner 

scanner axis prior to scanning that view. A 3x3 matrix coordinate system. The visual computer provides a 

system permits location of the scanning inputs relative value to be added to Ysand Zs to align the raster with 

to each view on the overall film plane, and for imple- the film image. Ys bias is entered into Ys bias register 

meriting the other mathematical operations described 134, and Zs bias entered into Zs bias 135 register 135, 

above for the matrix operator. Referring to FIG. 11, an and conducted to first and second bias adders 137, 138, 
input register 102 receives from the computer one of 45 whereby the bias signals are appropriately added to the 

seven 3x3 matrices which correspond one to each raw Y5 and Z5 signals. A computer monitoring circuit 

view to be scanned. The register is a nine word AJJ 139 is connected to the outputs of adder circuits 137, 

register, each word being 16 bits long. The output from i3g f or monitoring Y, and Z 2 are required, 

the input register 102 is fed to respective ones of a group Referring to FIG. 9a, 9(c) because the pseudc-film 

of nine multipliers 104, 105, 106, 107, 108. 109, 110, 111, 50 is dividcd jnto segments corresponding to 

112, which are part of a 3 x 3 matrix multiplier circuit tne views ^ from ^ sevcn lenseSj and the 

114 The matrix multiplier circuit serves to perforni a raster generator scans the entire pscudo film plane with- 

3X3 matrix transformation on the /xX*, M Y £ /iZ E out reganJ tQ the particular vjew wnich the 

information according to the relationship ^ scanning dot is passing, a separate circuit 141 (FIG. 3) is 

itfa-AH^A^Yj+AuMZ* (D P»wkted for identifying the particular view which is 

fiY £ = A 2 mXf+ A 22 >iY£+ A23*iZir, (9) «td f 0 ** 1 )? * ^ given moment. The output of the 

MZr=A3iuX £ +A32^Y£+E33/iZE. (10) view ldentlfier ,s compared with a view select code 

from the computer, as will be described, and informa- 

The values of Alj arc calculated by the visual com- 60 ^on derived from this comparison is fed through a write 
puter, and output prior to scanning each view of the enable line driver 143 to the scene storage system mem- 
film mosaic. These values are supplied by the computer orv for enabling the scene storage to write information 
on a view-by-view basis. The multipliers 104 through being received at that time period from the photomulti- 
107 are loaded with "A" matrix elements, and then plier tubes in response to the scanning of the film view 
information is entered from the selector 100 regarding 65 currently positioned for scanning, and no other. 
UZe which is sent to multipliers 106, 112, and 109. The PROM 163 assigns a unique three-bit view label 
Information regarding Xp (which is the same as jiXf) is to each view. When this label matches the three-bit 
received through multiple latches from latch 65 and fed view select code supplied by the computer, a write 
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enable signal is generated and data is stored in the scene Knowing the regular hexagonal configuration, then it 

memory 28. Video b directed by the computer to the follows that 
scene memory tracks that are selected for the zone that 

is being scanned. It b also delayed by an amount suffi- i 2_ (l „ 

cient to compensate for other delays between the pseu- 5 " 
do-film coordinate generator 60 and the data input to 

the scene memory. Included in these delays b a two Then 
microsecond delay in the cathode ray tube deflection 

driver system. As successive views are scanned, each *>= ks 3 - -^=- x Y F , 
complete zone is assembled in three tracks (each track 10 
holding one zone of one color, R, G, or B) of the scene 
memory. The view label is also used to select the color 

correction parameters view-by-view during read-out of x _ _i x ^ 

the scene memory for recording on tape. Thus it oper- Nf7 
ates at 10.7 MHz and is timed so as to partition the 15 

pseudo-film plane always along the same boundaries The latter two equations correspond to straight, diag- 

whether reading or writing. Thb partitioning defines ona j y tne& which are used in defining the boundaries 

the "joints" between film views during and after assem- between the respective views. The nominal hexagonal 

bling the full scene comprising the "pseudo-film." view boundaries in the pseudo-film plane described 

With respect to the raster generator timing, the clock 20 mathematically above, and in implementation below, 

rate b made as large as possible consistent with circuit ^ be varied by selection of constants and more gener- 

and scanner system hardware constraints. A retrace ^jy ^ y providing computer control to variously assign 

interval b provided to allow for CRT deflections set- portions of the pseudo-film area to corresponding film 

tling time. A blanking signal b provided during retrace views. 

to prevent CRT phosphor damage. Compensation for 25 Referring to FIG. 13, first and second data buses 152, 

deflection system delays by scan video processing de- 153 prov^e 13 bit numbers representing Y^and Xpto 

lays is provided to ensure that the scene memory write the exclusive nqR gate arrays 148, 149. Because of the 

signal, scene memory write clock, and data are properly symme try of the hexagonally laid out view, the exclu- 

synchronized. s j vc ^QR gates 148, 149 can determine the absolute 

Color separation optics 182 which comprise red, blue 30 values of x F and Y F . The output of NOR gate 149 b fed 

and green dichrotc mirrors are positioned in the optical tQ mu i t j p ii cr 150 and multiplied by a signal porportional 

train, for separating the color information derived dur- tQ a conslant representative of the value of the recipro- 

ing scanning of the film. Respective photomultipher ^ of thc ^ TQQi of 3> 
tubes 183, 184, 185 are positioned to collect the red, 
green, and blue emitted signals, respectively, for pro- 35 

viding electrical signals indicative of the respective x F = 

color intensity. The output signals arc fed through a ^ 3 

low noise amplifier 186 and through aperture correction .•.«.-• 

circuitry 187, successively through an A to D converter The output is conducted to comparator 151 where it is 

jgg 40 compared with the absolute value of X F received from 

The three photomultipliers generate signals propor- NOR gate 148, comparator 151 generating a signal 
tional to the red, green, and blue light intensities trans- indicative of whether the absolute value of X F is greater 
mined through the film. The gain of each PMT depends or less than the signal received from the multiplier 150. 
upon its anode voltage, under computer control. A Second comparator 152 compares the absolute value of 
preamplifier drives a cable which carries the signal from *5 X/? with a quantity received from adder 153 representa- 
the optical section to the video processing section. The tive of Vs 2 minus the absolute value of Y F divided by 
low pass filter 156 b provided, for each of the three the square root of 3. The output from comparator 152 
channels, which bandwidth limits the signal to below indicates which of the input signals b greater. Similarly, 
the Nyqubt frequency corresponding to the maximum the third comparator 155 receives inputs from the exclu- 
pixel rate. Provisions are provided for further band 50 sive NOR gate 149 and from input gate VSI 156 from 
width reduction when lower scan rates are used. The the computer. Input register 156 gives information re- 
resulting signals are buffered, having blanking inserted, garding VSI, and the other input comparator 155 pro- 
and provisions are made, through the use of a low pass vides information from exclusive NOR gate 149 regard- 
filter circuit 190, for further band width reduction when ing the absolute value of Y F , Similarly, input 150 pro- 
lower scan rates are used. Resulting signals are accessi- 55 vides an input corresponding to VS3 to the adder circuit 
ble to the operator's console for observation on an XY 153. The outputs of the three comparators 151, 152, 155 
monochrome cathode ray tube monitor. The green are fed to the view label PROM circuit 163, along with 
signal alone b used for film frame label identification. the sign values of Xf and Y Fy the PROM memory 163 

The view identifier information is also fed through having been programmed with tabular information 
data path 145 to the gamma map and to the luminence 60 which is employed to determine from the input informa- 
and color correction circuitry 146 for permitting selec- tion which view is being scanned at any particular mo- 
tion of the appropriate gamma map luminance, and ment. The output from the prom b fed to a delay latch 
color corrective data for each pixel read from the scene to a comparator circuit 164 which also receives an input 
storge system 28. Referring to FIG. 9(c), VS2 is the via data 165 link from a computer register 166. The 
dbtance between the center of the hexagonal center 65 visual computer maintains information regarding the 
view and its top boundary, VS* is the distance between current view being scanned on the photographic trans- 
the left corner of the hexagonal view and its top left port plane, and it feeds information, through the view 
corner, and VS33 is the width of the hexagonal view. select regbter 166, indicative of the respective frame 
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being scanned on the film transport. The comparator shifted into an 8-bh shift register 198 (FIG. 15). When 
compares the view select information from the visual this register is full (after eight clock cycles), a buffer 199 
computer with the raster scanning information rcpre* is loaded, and the data is held until corresponding data 
senting the momentary position of the scanning dot, and is available from all three tracks. This buffering is re- 
provides an indication when the scanning dot is within 5 quired because there can be a differential delay in the 
the boundary of the view. This information is delayed scene storage system memory 28 of several hundred 
and synchronized in a delay and synchronization timing nanoseconds. When the buffered data stream is then 
circuit 164, which synchronizes video information with inputed from the buffer 199, it is again converted to 
information received directly from the PROM circuit serial format, by "parallel in-serial out" conversion 
163, and delays the output through output line 167. 10 circuit 200 (register circuit) prior to inputting into the 
Output 167 is connected to the differential line driver color correction circuit 29. 

143, which enables the scene storage system 28 to write A luminence signal, representative of the intensity of 

into memory, the delay serving to synchronize the input the signal, is obtained as a weighted sum of the red, 

from the comparator 164 with the video signals derived green, and blue signals, the weights being defined ac- 

from the CRT through the photomultiplier tubes. 15 cording to NTSC standards, as 0.3, 0.59, and 0,1 1, for 

The rastering position command signals are deter- red, green, and blue, respectively. The resulting lumi- 

mined by the "Y" and "Z" adder circuits 137, 138 nence value is used to arrive at a common, gamma map 

whose outputs are latched and fed to digital-to-analog input for the three colors. The gamma map, as will be 

converter circuits 169, 170, respectively, whose outputs understood by those in the art, is the implementation of 

are fed through leads 171, 172 through first and second 20 a graph with luminence values charted as one axis (ab- 

low pass filers 173, 174 which, in turn, are inputs to the scissa) and gamma factors on the other axis (ordinate), 

analog deflection driver circuitry 175 provided for driv- A different gamma map can be stored for separate 

ing the cathode ray tube 176. An analog beam intensity views. Referring to FIG. 16, a weighted summing cir- 

control circuit 177 is provided for intensity control of cuit 203 effects this processing through the use of first, 

the CRT under control of the computer and the blank- 25 second, and third PROMs 204, 205, 206. PROMS with 

ing circuit 180, FIG. 12. table lookup constant multiplication tables correspond- 

The A to D converter 188 is a video rate 10-bit de- ing to the 0.3, 0.59, and 0.11 constants, are employed to 
vice. A random access, 1KX8 memory 191 receives the permit rapid multiplication. The output of PROMs 204, 
digitized information for the respective channel, and in 205, 206 are latched by latching circuits 207 and 208, 
the drawing, one typical channel is shown. Similar 30 and added by adder 209 to provide at lead 210 a corn- 
RAM memories are used for the other two channels, mon output weighted sum of red, green, and blue val- 
respectively. The ram memory receives the digitized ues. The B-bit luminence value transmitted through lead 
information as addressing information, and are loaded 210 is multiplexed with the 3-bit label in the MUX mul- 
by, and may be read by, the computer 16. A reciprocal tiplexer latch circuit 211. The MUX latch multiplexes 
function is generated which corresponds to the positive 35 the 8 bits corresponding to luminence with the view 
red, green, and blue data, which in turn is conducted label received from the view identifier circuit through 
through a latch circuit and loaded through a selector delay circuit 165, and the 11 -bit address formed is in- 
192 in a differential line driver 193 for loading into the puted to the gamma map ram memory 214 which, out- 
scene storage memory 28. The selector 192 provides a puts the suitable gamma factor to multiplier circuits 
transmission either of the current rastering information 40 215 A, 21 SB, 215C, which in turn receive respective 
from ram 191, or, alternatively, a test pattern generated signals from the scene data synchronization circuit 197 
by test pattern generator 194 or information from a which have been latched by latching circuits 216 for 
video digitizer system 195 which is employed for re- synchronization with the gamma factor output. The 
viewing particular frames which have been recorded in inputed gamma factors thus serve through the multi- 
the video disc memory system. The remaining parts of 45 plier circuits 215A, B, and C, to perform luminence 
the record circuitry serve to process the information, correction on the raw color intensity signals. The 
correct and coordinate the views with respect to color gamma map 214 is initially loaded with information 
and luminence values, and then to feed information provided through data (ink 217 from the computer and 
through a signal compression system 29 adapted to the address link 218 as required for the particular scene, 
format the digital signals so as to allow encoding into 50 Signals outputed from multipliers 215A, B, and C are 
NTSC color format. Recording on at least one of the thus luminence corrected, and are subsequently color 
video tape recorders 16 (as seen in overall diagrammatic corrected in multipliers 217A, 217B, 217C, each of 
view in FIG. 3) provides the output of the record sys- which receives a multiplying constant from a 21 -word 
tern. The circuitry 29 for compressing digital signals to buffer circuit 220. The 21 -word buffer 220 has been 
allow subsequent NTSC encoding is described in detail 55 loaded from the computer with sets of color corrector 
in the co-pending patent application Ser. No. 294,546 constants for each color, and for each view from the 
filed Aug. 20, 1981 of John T. Hooks, Jr., entitled computer, and its outputs are synchronized with the 
"Method and System for High Density Analog Data other inputs to multipliers 217A, B, and C in accordance 
Storage, Retrieval and Transmission, 1 ' which describes * with the view label input received from the view identi- 
the encoding procedure for one black and white chan- 60 fier circuit through conductor bus 145, through latches 
nel, which application is incorporated by reference into 221, and subsequently delayed in five clock delay cir- 
the present specification. cuit 222 for providing select input signals to the 21- 

For scene data synchronization, in the record mode, word buffer 220. 
Red, Green and Blue are read from their respective In operation, an operator views the raw signals taken 
tracks in the scene memory 28. At this point, at least 65 from the scene memory by means of a monitor con- 
two views have been assembled in the scene memory — nected to the frame buffer 30. If colors are not as re- 
one track for each color component of each zone. The quired, he inputs color correction signals into the 21- 
scene memory is clocked at 10.7MHz, and the data is word buffer 220 by keyboard input connected to the 
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computer, and the signals are subsequently corrected provide the capability of storing information* regarding 
before entering into the recording media. After being portions of the photographic plate being scanned, (at a 
luminence and color corrected, the signals are each scanning density of nominally 72 zones). Because of 
passed through respective video processing and con- limited capacity in the buffer, the capability exists of 
verison circuits 225 for formatting the digital color 5 viewing only a small portion of the total scene at any 
signals for subsequent conversion into NTSC-compati- one time using the frame buffer. However, it may also 
ble analog signals. The reason for this conversion is to be recalled that the density of scanning is programma- 
permit their convenient recordal on the tape recording ble, and that a low resolution picture can be produced in 
medium, and subsequently, on high density video discs. which one scene equals one frame, which provides a 
These circuits are described in detail in the co-pending, 10 coarse view of the overall photographic plate. In nor- 
above-mentioned patent application. The insertion of mal operation, it is sufficient to store information re- 
NTSC synchronization pulses into the long scan lines to garding portions of the film in the buffer memory and to 
arrive at NTSC compatible short scan line signals is reproduce these on a monitor screen, not shown, to 
accomplished by the overlap memories 226 in coopora- permit color and geometric correction, 
tion with the digital-to-analog conversion circuits 227, 15 To start loading the buffer, the frame buffer loading 
connected in scries, each channel comprising one of the start address is supplied by the computer unit 19 or 
circuits as described in the above-mentioned patent computer. As the computer 19 commands transfer of 
application. Aperture correction circuits 228A, B, and sequential zones from the scene memory 28 to the frame 
C are provided in series with the digital-to-analog con- bufTcr, the start address is loaded. When the frame 
verters 227 for providing aperture correction, and the 20 buffer is read, the start address is generated at the start 
signal is next passed through low pass filters 230, 230A, of each \vs\c in such a way as to produce interlaced 
230B, 230C, with a cutoff of 2.5MHz. Signals are con- video. For Red, Green, Blue, and Y data, the required 
verted to standard NTSC color format using commer- sequence is even multiples of 540 for even fields and odd 
cially available color encoder circuits 231. The output is multiples of 540 for odd fields. For I and Q data, the 
fed through line driver circuits 232 to at least one tope 25 required sequence is 0 pixels, 540 pixels, and 1080 pixels 
recorder, suitably a standard TV studio recorder having because only 240 lines are stored, so data is repeated for 
addressable edit insert capability. Multiple tape record- even and odd fields. Hardware to generate these start- 
ers provide the capacity to record multiple zones for ing addresses is provided and enabled when the frame 
increasing readback access speed, as will be described . buffer is in the display mode. 

below with respect to the playback system. 30 The frame buffer circuit receives color corrected and 
An NTSC synchronization signal generator 234 pro- luminence corrected red, green, and blue signals from 
vides proper synchronization and subcarrier signals to the outputs of the multipliers 217A, B, and C, before it 
the NTSC color encoder 231. is formatted into NTSC format for recordal in the tape 
In converting to analog video format, all synchroni- recorder. After storing in the frame buffer, the informa- 
zation and subcarrier timing relations are consistent. 35 tion is fed back from the frame buffer through selector 
When the number of NTSC lines per long line is even, circuits 244A, B, and C. Information is fed back through 
the component pixels for odd long lines are delayed by the selector circuits through the NTSC processing cir- 
one half cycle of the color burst frequency before mod- cuit to the monitor for operator viewing and for subse- 
ulating into composite format, thus reducing the lumi- quent correction of the signal. During normal recording 
nence/chrominance cross contamination when long- 40 of the information from the transparencies, the scanning 
line to long-line averaging is performed downstream. signal derived from the analog deflection driving circuit 
Provision is made for generating and recording on 175 is non-interlaced, for scanning efficiencies, and it is 
the tapes full-field test data in either of two formats. stored in the tape recorders and discs in the non-inter- 
One format comprising color bars for use in the disc laced format. However, when it is desired to monitor 
mastering setup process, and the other is the format 45 the signal on a monitor screen, it must be input into the 
required by the automatic color corrector circuit in the monitor in the interlaced mode for clarity of viewing. 
VDS for the automatic setup systems. Either of these and the signal stored in the non-interlaced mode in the 
may be selected by the computer. The parameters of frame buffer memory 214 is converted to interlaced 
these signals are fixed by constants. A test pattern may mode by being read out in interlaced mode when it is 
also be inserted in the "ofT-photo corners" of the pseu- 50 fed back through the selectors 224A, B, and C for pro- 
do-film scan area. It consists suitably of non-overlap- cessing in the NTSC conversi on circu it 
ping squares generated by combining various bits of the For reading out information regarding R, G, B f and Y 
pseudo-film coordinate signals Xf, Yf. A frame buffer from the memory 241 in the frame buffer 30, interlace 
circuit is provided for holding three tracks of video for read addresses are provided through the start address 
display information regarding the red, green, and blue 55 generator 242 as follows. The NTSC sync generator 
signals of one frame. The buffer consists of three scene 234 provides a first field index number through input 
memory circuits which form a frame buffer. The first 248, and selector 247 selects a 0 pixel input for feeding 
259,200 locations out of 327,680 contain 480 lines of into the selector circuit 249 which is latched in latching 
active video with 540 pixels per line. Lines are not circuit 250 and fed through selector circuit 254 and 251 
interlaced. 60 into the frame buffer memory 241. This in effect permits 
The purpose of the frame bufFer system is to permit the frame buffer memory 241 to be read along alternate 
monitoring of the picture being scanned prior to its video lines starting with line number I. Hard wired 
recordal on the tape media. In operation, it is advanta- constants of 1080 are fed also through adder 246 and the 
geous to monitor the scene stored in the scene storage sura of 1080 is added from the output of latching circuit 
memory 28 prior to its recordal in the tope and disc 65 250 to the previous address through selector 249, which 
mediums, and to correct any deficiencies in color bal- allows the skipping of 1080 pixel addresses thereby 
ance between the respective views and any geometrical allowing the reading process to skip one line and pro- 
mismatches. The frame buffer circuit 30 thus serves to vide interlaced output. Selector 254 is activated from a 
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buffer input 253 from the computer which inputs a start 
address for R, G, B, and Y factors. A corresponding 
computer buffer input 252 receives starting addresses 
for I and Q factors which enable the selector circuit 251 
and the start address generator circuit 255 for I and Q 
factors. Stan address circuit 255 consists of an adder 
circuit 256 connected in series with a latch 257, the 
adder circuit receiving from a hard wired constant a 540 
constant factor. This enables it to repeat each I and Q 
line twice to compensate for encoding done at the video 
digitizer system 195, as will be more fully understood 
from the description of the playback system hereinbe- 
low, the monitor system can also monitor material 
which is loaded onto the tape or discs themselves, albiet 
in scrambled form. The reading of information from the 
discs is accomplished through the video digitizer system 
195, which will be more fully described hereinbelow 
with reference to the playback section of the circuit. As 
will be understood from that description in more detail, 
when analog video information from the video disc is 
played into the video digitizer system 195, it is com- 
pressed for storage efficiency in the scene storage sys- 
tem 28. This presents difficulties when it is desired to 
view the material on the monitor, in that the com- 
pressed material must be expanded, and the red, green, 
and blue channels cannot handle the compressed Y, I, 
and Q information. Therefore, a separate circuit path is 
provided in the recorder system when the Y, I, and Q 
signals are to be expanded before being viewed or fed 
through the frame buffer for viewing. 

Output information is derived from the video digi- 
tizer system 195 (FIG. 2) fed through the scene storage 
system 28 through the scene synchronizing circuit 197 
and then through an IQY loading circuit 260 for pro- 
cessing prior to loading into the frame buffer memory 
241 

After the disc or tape has been read and the data 
digitized and stored in the scene memory 228, it has the 
"playback 1 ' format, 

Even Long Line Y..Y..Y..I Y..Y..Y..I 

Odd Long Line Y..Y..Y..Q Y..Y..Y..Q 

As the first four pixels are read from the scene, they 
are stored in four latches 261, 262, 263, 264. At this time 
the three Y values are loaded into a shift register 265 
and I is loaded into a .buffer circuit 266. A timing and 
control circuit 267 provides three clock pulses gener- 
ated at 10. 7MHz, which clock the three Y bites out of 
the shift register and also generates a series of three 
repeated I bites. These two data streams are clocked 
through two low-pass filters 270 and 271 which perform 
bandwidth limiting. The fitter parameters are under 
control of the computer. This expanded scene informa- 
tion is then fed through first, second, and third selector 
circuits 272, 273, and 274 into the buffer memory 241 
providing expanded scene information in color from the 
selected portion of the disc, and the Y, I and Q informa- 
tion is converted to red, green and blue signal informa- 
tion through a 3x3 matrix multiplier circuit 275 which 
provides Y, I, and Q to RGB conversion. The constant 
coefficients of the multiplier circuit 275 are provided 
from a computer input 276. Thus, the signal transmitted 
through the 3 X 3 multiplier is expanded, red, green, and 
blue, and interlaced information but remains in the 
scrambled format used for recording on the tapes and 
discs. Data may be loaded from the scene memory 28 to 
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the display buffer 241, and the resulting data in the 
buffer will correspond to data within a field of view 
window in the scene memory. The computer must spec- 
ify three numbers to define the window: (1) WFND1- 
5 the number of pixels that are skipped before the first 
pixel is written into the buffer; and (2) WIND2- the 
number of pixels that are utilized for storage in the 
buffer; and (3) WIND3- the magnification factor for the 
data. WIND1 information is provided from WIND1 
10 register 281, WIND2 from register 282, and WIND3 
from register 283. 

To review the process in the display buffer, WIND1 
is representive of the number of pixels which are en- 
tered in by computer control to the display buffer 
15 which determines the number of pixels which are to be 
skipped before the write for enabling the buffer memory 
241 to store information regarding the first portion of a 
desired window. WIND2 is the number of pixels that 
are utilized for storage in the buffer of a desired win- 
20 dow. WIND 3 represents the number of pixels to be 
skipped before the next "write' 1 is enabled for storing 
the next lower portion of the window as the overall 
pictures scan downwardly. This circuit generates 
"write" clocks for each of the memories within the 
25 buffer memory 241. Separate clocks are required be- 
cause I and Q data are available only during alternate 
lines. A display cross-hair generating circuit 281, in- 
cluding down counter 282 and downcounter 283, is 
provided for generating a pair of cross hairs consisting 
30 of a horizontal line which is one scan line in height and 
a vertical line with a width which is approximately 
1 /200th of the display monitor width, generated when 
enabled by the computer. Position and color of these 
lines are determined by the computer. 
35 Referring to FIO. 20, the video storage system 28 
comprises the bank of 16 disc players which, when 
scanned under control of the computer, provide up to 
three channels of output information corresponding to 
one scene of information corresponding to the particu- 
40 lar scene which has been selected for display. The infor- 
mation is fed through the video digitizer system 195 
which functions to process the analog composite video 
from the video storage system 28 and send digitized 
video to the scene storage system 28. The video digi- 
45 tizer system 195 has three identical channels, as seen in 
FIG. 6 as channels 300(a), 300(6) and 300(c), since at 
any given time three video disc players can be simulta- 
neously accessed. The quasi-NTSC video from the 
Video Storage System memory is read, time based cor- 
50 rected by time base corrector 302, clamped and con- 
verted to digital format by an analog/digital (A/D) 
converter circuit 303. A composite luminance and chro- 
minance processor performs composite video-to-com- 
ponent video conversion and spatial compression of the 
55 digitized video in an effort to take advantage of the 
redundancy present in the I and Q components of the 
color signal and to save memory storage space, in the 
scene storage system 28. The video digitizer system, as 
will be described in more detail, interfaces with the 
60 visual computer 19 through a computer interface circuit 
306 and provides interface between the visual computer 
19 and the rest of the visual system hardware. 

Referring to FIO. 22, three digitizer channels are fed 
into the scene storage system which includes two identi- 
65 cal storage sections 308, 309, each storage memory 308, 
309 having a maximum of up to 128 tracks of informa- 
tion which is sufficient to record at least one scene of 
information from a respective digital disc. 
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The scenes represent information derived from re- red, green, blue generator 333 which converts- the Y, I, 

spective ones of the zones of information into which Q signals into red, green, and Woe signals. The red, 

pictures are recorded, up to 128 zones being employed green, and blue signals are fed through a special effects 

for recording information derived from one scene. generator circuit 334 which, as will be understood. 

Each track has the capacity to store digital video 5 inserts information simulating sky color, haze, fog, and 

information, including color, present in one NTSC line the like. The output of the special effects generator 

TV frame (1/30 of a second). Video information is read circuit 334 is fed to a line buffer and digital-to-analog 

to one of the memory sections 308, 309, while it is writ- conversion circuit 335, which compresses in time the 

ten from the second section. When fresh data is re- information derived for a particular line and converts 

quired, the input side becomes the output side and vice- 10 the signal to TV analog format for driving the video 

versa. Three channels of data are thus input to the scene display projectors. A control synchronization circuit 

storage memory system, FIG. 22, and the scene storage 337 which in actual practice comprises a portion of the 

system in turn outputs multiplexed Y, I, and Q digital control circuit 328, operates to generate standard 

data to the cell processor systems 312(a), 312(6), 312(c), NTSC synchronization pulses for synchronizing the 

and 312(d) as seen in FIG. 2. 15 TV projector, the line buffer and D/A conversion cir- 

An address and data bus 213 receives inputs from the cuit with the cell processor output 

visual computer 19 through the video digitizer 195 and The playback system, as can be understood from the 

an interface control circuit 214 includes registers receiv- above description, thus incorporates a sequence of 

ing these command signals and, under computer con- memory systems which progresses from a large, fixed 

trol, selects the appropriate tracks necessary to be read 20 memory incorporated in the video storage system 28, 

out into the cell processor memories for reproducing from which a portion of the information is read under 

the required portions of the original scene correspond- control of the video computer 19, to smaller but faster 

ing to the current location of the simulated aircraft. memory segments 308, 309 of the scene storage system 

Selection of the appropriate tracks is accomplished 28. Each memory segment 308, 309 stores digitized 

under computer program control. A plurality of output 25 information corresponding to at least part of one visual 

buses 215, one per active memory track within the com- scene, i.e., a reconstructed image corresponding to at 

puter memory segments 308, 309, transfers the informa- least part of one initial transparency 40. Depending on 

tion on the track selected under the control circuit 214 the number of frames which record the particular scene 

to a dual multiplexer 217 which serves to route the being transferred from the discs, several seconds may be 

selected information to the cell processors which are 30 required to read out the information from the disc and 

connected to the visual display appropriate for display- to store it in one of the memory segments 308, 209 under 

ing the particular view or scene portion selected. In the control of the visual system program, and stored in one 

present application, four active cell processors and pro- of the smaller, but higher speed memory segments 

jector systems are employed. The multiplex includes 325(a), 325(6), (FIG. 23) of a respective one of the cell 

four output buses 218(a), 218(6), 218(c), 218(d), for con- 35 processor systems 312(a), (6). (c% (d). Each cell proces- 

ducting information to the appropriate cell processor sor memory segment 325(a), and 335(6), stores informa- 

for projection on the appropriate screen. The raulti- tion for reproducing one out4hc- window view and 

plexer circuit acts as a switching circuit to route the during rapid simulated motion, may be changed every 

output from any track of the scene storage system to 1/30 second visual display change cycle, 
any one of the cell processors. 40 Reading out of the information stored in the cell 

As seen in FIG. 2, any one of the data buses 218(a), processor memories 325(a), 325(6), is accomplished by 

218(6), 218(c), 218(d) is inputed into a respective one of the raster generator 60, which generates a series of 

the cell processor units 312(a), 312(6), 312(c), and addresses in the high speed address generator which 

312(a*), respectively. address and cause to be read out, selected portions of 
As seen in FIG. 22, each of the data buses includes 45 the cell memory segments 225(a), (6). The transforma- 

four channels for transmitting the data from four tracks tion, or manipulation of a portion of a view to distort, 

in the memory 308, or 309. Bus 218(a), for example, i.e., to skew, rotate, or magnify or otherwise distort the 

includes channels 320(a), 320(6), 320(c), and 320(d), view, as would be seen by a pilot during motion occur- 

each of the channels transmitting information derived ring between points of view requiring new overall 
from one track in the memory 308, 309 to a respective 50 scenes to be recalled from the video storage system disc 

input interpolator circuit 321(a), 322(a), 323(a), and memory 28, is effected by mathematically controlling 

324(a) in the cell processor system 312(a), as seen in the output of the address generator, to produce what is 

FIG. 23. The interpolators 321(a), (6), (c), and (d), as termed herein a "Hne random address sequence" read 

will be more fully described below, optimize the pixel out pattern from the cell processor memories 325(a), 
density of the incoming signals, and perform filtering 55 (6), as will be more fully understood from the descrip- 

functions for optimizing its form for storing in the cell tion to follow. 

memory segments 325(a) and 325(6) of the cell proces- VIDEO DIGITIZER SYSTEM 
sor memory circuit 326. The two cell memory segments 

325(a), 325(6) are "ping-ponged" for alternative filling The video digitizer system is the central source of 
and reading into the multiplexer circuit 327, the control 60 various clocking, synchronization, control and test sig- 

of the memories being derived through control circuit nals for the Visual System. The Visual Computer 19 

328 from an input, under command sent through a com- communicates with the Visual System via the Com- 

puter interface bus 329 from the digital video digitizer puter Interface 416. The interface provides buffering, 

system 195. A high speed address generator 330 is em- handshaking, and timing signals to a common bus which 
ployed for addressing the portion of the memory being 65 is shared by all systems. The Visual Computer 19 sets 

currently read for generating an output corresponding the operational mode of the Video Storage System via 

to the particular picture portion being read for projec- the Computer Interface. The modes are (I) Channel 

tion. The output of the multiplexer 327 is fed through a Enable, (2) video Reference Frame, and (3) Built-in- 
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Test. The individual bits control the internal configura- indicates a video drop-out has been detected. Due to the 

tion of each digitizing channel. In general , the Video long-line nature of the video masking of drop-outs is 

Digitizer Sytem 195 processes data continuously in a accomplished external to the Time Base Corrector. The 

"pipe-line" manner. As the Video Storage System 14 drop-out indication from the selected disc maintain a 

outputs video data, the Video Storage System 195 pro- 5 fixed correlation with the corrected video from that 

cesses and sends the data to the Scene Storage System. disc. Normal drop-out compensation is disabled and 

When a digitizing channel is in the Channel Enable several sequential lines are read before a common adja- 

modc, the Channel Inactive signal will go low when- cent area of the picture is repeated in contrast to normal 

ever valid pixel data is presented to the video digitizer. TV scanning techniques.) 

While in this mode, the active Video digitizer system 10 With reference to FIGS. 8 and 21, the fundamental 

channel assumes that the video will be used to establish timing and synchronization signals are derived from the 

video correction factors. The correction process is ini- synchronization, control, and test generation circuit 411 

tialized at the start of the frame and continues until the which is incorporated into the video digitizer circuit 

end of the frame. These factors are used during subse- 195. The 30 HZ frame synchronization signal feeds the 

quent frames as gain and bias constants. The factors will IS disc players, causing synchronous rotation inphase with 

not change until the next Reference Frame mode unless the 30 HZ clock, feeds the computer 19 to provide 

a reset command is sent. frame cycle computation interrupt, and feeds all the 

When the Video Digitizer System is in the Built-in- other processing and downstream of the video digitizer 

Test mode, a video test signal (generated by hardware circuit 195 which cycle at 30 HZ. Referring to FIG. 25, 

internal to the VDS) is applied to the digitizing chan- 20 the clocking and control circuit comprises a conven- 

nels. Video Storage System data will be ignored. All of tional, NTSC sync generator 411(a) and a clocking 

the other Operational Control Word bits are functional circuit 411(6) having a high frequency timing circuit 

in this mode. which is divided into several lower frequency clock 

Digitizer Control - The Visual Computer 19 via the outputs, including the 30 HZ signal. 
Computer Interface 413 can set various constants in 25 Preceeding each scene on the discs, there is recorded 

each digitizing channel 300(a). (b), (c). Also, specific a test pattern having known chrominance and lumi- 

functions can be disabled. Normally, the sequence of nance levels recorded for providing convenient color 

events is as follows; and brightness matching between scenes during play 

(a) After power-up, send Master Reset, send the back. Before each scene is entered into the scene storage 
"base Line*' control word (Channels disabled, VR 30 system this reference signal is standardized by the auto- 
disabled, AVC enabled, BIT disabled), send the matic video correcting circuitry 422, by comparing it to 
AVC constants (Chroma gain, luma gain, luma predetermined values of chroma and luminance, 
bias). The Video Digitizer System (VDS) 195 is the func- 

(b) When operation is required, send VR Enable tional unit which processes analog composite video 
during the reference frame, send Segments per 35 from the Video Storage System (VSS) 14 and sends 
Line, send Channel Enable at the start of the appro- digitized video to the Scene Storage System (SSS) 25. 
priate Video Storage System transmission. The VDS 198 also provides the interface between the 

Note: The Visual Computer coordinates the opera- Visual Computer 195 and the visual system. Further, 
tion of the Video Digitizer System 198 with the VSS 14 the VDS 195 provides test, synchronization, and con- 
to insure that the VDS will send valid data to the Scene 40 trol signals for the VDS. A test panel is included in the 
Storage System 28. VDS to provide limited manual testing of the VDS. 

System Timing and Synchronization - The Video The VDS has six functional secions: three Digitizer 

Digitizer System 195 provide a 30 Hz interrupt signal to Channels, 300(g), (6), (c), Timing Generator 411, a 

the Visual Computer 19. This signal coincides with each Computer Interface 306, and a Test Panel, 
video frame sync. The disc players and all system oper- 45 PXJCKITA _ TnKI 

ations will "lock" to this sync. DIGITIZER; DETAIL IMPLEMENTATION 

The Video Digitizer System also provide clock sig- The VDS has three identical digitizer channels (FIG. 

nals to link the transmission of pixel data between sys- 21), each of which accepts quasi-NTSC composite 

tems. video from the VSS (FIG. 21). FIG. 25 shows a more 

Computer Interface - The Visual Computer 19 com- 50 detailed block diagram of the basic channel. Each of the 

municates with the various systems via the Computer three channels sends to the SSS 28 an output data clock, 

Interface 413. Each system is assigned a block of ad- a channel inactive signal, plus an 8-bit multiplexed lumi- 

dresses unique to that system. The CI provides a "party nance/chrominance signal. The output video is delayed 

line" bus that links all systems to the Video Storage by one NTSC line time relative to the drop-out pulse. 

System. A system that recognizes an assigned address 55 This relationship allows an increase in the drop-out 

will respond to the associated data. width to insure complete masking of the video-drop. 

Basic Digitizer Channel - The requirements of the The TBC is supplied a reference composite-sync 

basic channel of the Video Digitizer system are as fol- signal from the sync generator 411(a) and a reference 

lows with continued reference to FIG. 25, the time-base subcarrier signal from the master clock 411(6). The 

corrector (TBC) 302 for the video digitizer is suitably 60 output video from the TBC is be genlocked to both of 

Nippon Electric Company model NTCF5000. The these sources. The TBC generates an advanced sync for 

TBC 302 standaridizes the time base of quasi-NTSC the disc player as a rotation reference, 
composite video received from the Video Storage Sys- Clamper— The TBC 302 is not sufficiently clamped 

tern video disc players. The Time Base Corrector has to inhibit the composite video output from shifting with 

velocity-compensation circuitry to correct rotation 65 the average picture level. The "front porch" of the 

errors of the video disc players. quasi-NTSC video signal is sampled and restored to a 

The Time Base Corrector 302 provides an input to reference level. This is accomplished by a convergent 

accept a signal from the Video Storage System 14 that feedback process that biases the TBC video output. The 
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sample occurs at 657C from horizontal sync. As shown 
in FIG. 23 and in greater detail in FIG. 32 a clamping 
circuit 415 receives the digital sample at the chroma 
A/D converter 416 (to avoid the luma low pass filter 
delay) and develops an analog bias signal. The bias 
signal is summed with the incoming video by an analog 
summing circuit 417, FIG. 32 to reduce the shift. The 
loop again of the clamper 415 is set to optimize the error 
convergence. 

Luminance Low Pass Filter— The luminance signal 
path is passed through low pass filter circuit 418 to 
attenuate chroma interference. The filter response may 
be obtained using an Allen Avionic's VFL2P2 filter, or 
equivalent device. 

Luminance A/D Converter — The Luminance signal 
is digitized at a 10.7 MHz rate by a luminance A/D 
converter 419, suitably an Analog Device's MATV- 
0816 A/D converter or an equivalent. The output of the 
converter 419 has an 8-bit, two's complement format 

Output signals from the video clamper 415 are also 
feed to a Chronunance A/D Converter 410. This con- 
verter 416 operates at four times the burst frequency. 
The luminance and chrominance sample rates are syn- 
chronized via the Master Clock 411(fr). A Chroma 25 
Bandpass Prefilter 420 is placed before the chroma 
decoder 421 to provide additional luminance rejection. 
The Chroma Decoder 421 operates with respect to the 
B Y and R-Y axes rather than I and Q axes. It should 
perhaps be noted that the "P and **Q" notation em- 30 
ployed in the description of the visual provision is 
equivalent the 1BY and QRY notation employed herein- 
below. The chroma separation into IBY and QRY sig- 
nals is performed using phase-sensitive digital filtering 
by properly weighting a sequence of samples which 
bears a fixed relationship to the color-burst phase. The 
chroma samples to the decoder are represented by the 



10 



15 



20 



A BCD A' BCD* A"B'C'D' A'-fCCT" 



(last) 



The decoder 421 performs the following operation on 
the series to resolve the IBY and QRY components: 



(by - !UK -0 + ha - 01 (i) 
QRY = \[k{B - D) + \{B - &)\ (2) 



(1) 
(2) 



Four input samples are accumulated for each output 
sample, producing a 3.58 MHz output sample rate. FIG. 
33 shows an implementation of the above equations. 

Error averaging is accomplished by summing 64 sam- 
ples at a 10.7 MHz rate in an accumulator, then dividing 
by 64. This averaging process is necessary to reduce the 
effects of noise and dropouts during the time period of 
each reference level. A PROM error lirniter is used to 
increase the correction time-constant for large errors. 



registers are preset to nominal values (unity gain, zero 
bias) on power-up or reset. 

An Automatic Chrominance Corrector Circuit 425 
section 427 of the AVC contains two major compo- 
nents, a chroma gain corrector 427 and the chroma 
phase corrector 428. The encoded VR chroma signal is 
of the same phase and P-P amplitude as the burst Since 
the IBY and QRY axes are used for demodulation, the 
VR amplitude and the sine of the VR phase error are 
available as the IBY' and QRY' outputs, respectively. 
When the VR chroma signal is properly decoded and 
corrected, the QRY component will be zero and the 
IBY component will be equivalent to 40 IRE units. 

The operation of the chrominance gain corrector 427 
is similar to the luminance gain corrector 423. 

The chrominance phase corrector 428 is similar to the 
previous correctors except for control to the axes. A 
coordinate rotation process uses the value of the phase 
register to rotate the IBY' and QRY' axes. The direction 
of rotation reduces the QRY phase error. 

A Gamma Corrector 426(d), (b) is connected to re- 
view output from the luma corrector 423. For each 
value, a number K(Y) is determined by a RAM look-up- 
table and this number is used to multiply Y. Since there 
are three time sequential values of Y for each value of 
IBY or QRY, the three values of KXY) are averaged 
before multiplication with IBY and QRY. 

A RAM containing the K(Y) table is loaded and read 
by the Visual Computer. The loading of the RAM is 
done by a high speed data-block transfer via the CI. 

A transverse filtering and drop out correction circuit 
430 is connected to receive the gama corrector outputs. 
The original video generated by the film-scan process is 
a long-line type which does not have a blanking/sync 
interval every 63us as NTSC format does, but has a 
blanking interval only every N,NTSC line times, where 
Nj is programmable (similar to the FSS output of the 
Record System Film Scanner). 

The Record System converts this long-line video into 
the "NTSC" format required by the disc-mastering 
process. N,is typically an even number (from 4 to 10). 
The horizontal and vertical blanking intervals are used 
in the VDS 195 as "dead" times for hardware update, 
control, etc. The VDS 195 continuously processes 
NTSC lines. During the appropriate sections of a scries 
of NTSC lines, the VDS enables the SSS Pata Clock 
and towers the Channel Inactive signal. The SSS 28 
may then accept the VDS output 
The transverse filter and dropout correction circuit 
50 420 also performs Drop Out Correction, and when a 
drop-out is detected, the faulty portion of a recon- 
structed scan line is replaced with the corresponding 
section of the previous reconstructed scan line. This 
requires that video samples be stored from the previous 
Nj "NTSC" scan lines. N, is a constant provided by the 
Visual Computer 19. The VDS 195 stores a series of 
NTSC lines into a memory. The memory addressing is 
restarted every N, lines. 
The time base correction (TBC) drop-out signal 
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40 



45 



55 



In addition, the transfer function of the lirniter deter- 60 (TBCDO) is sampled and stored in a memory to pro 



mines the loop gain of the corrector. The loop gain is set 
to optimize the error convergence during the VR 
frame. 

The output of the error lirniter is time integrated and 
accumulated into registers. The values of these registers 65 
cause the luminance and background levels to converge 
toward the reference levels. After the VR frame, the 
gain and bias registers hold their last values. These 



vide a hardware programmable delay of nominally one 
NTSC line time. TBCDO leads the video drop-out by 
about one NTSC line time. A memory delay of less than 
one line allows an increase in the TBCDO pulse width. 
This overlap procedure insures masking of the video 
drop-out. Whenever the delayed TBCDO becomes 
active, the prior reconstructed line data is sent to the 
SSS 28 and also recirculated to mask the drop-out. 
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The Chrominance Transverse Filter, a portion of the 
transverse filter circuit 430, permits a scan line averag- 
ing technique to be used to improve the chrominance 
S/N ratio. Since the Drop-Out Corrector contains the 
stored video necessary to average two reconstructed S 
lines, the Transverse Filter is implemented with two 
summing networks. 

A lu ma/chroma data multiplexing and output format- 
ting circuit 431 next serves to multiplex the data from 
the transverse filter circuit 430. The data sent to the SSS 10 
28 is time multiplexed as follows: 



Reconstructed even line: 
Reconstructed odd line: 



YYY I YYY 1 YYY I . . . 
YYY Q YYY Q YYY Q . . . 
(PAIRED CHROMA DATA) 15 



20 



1BY and QRY data are alternated line-by-line. In order 
to maintain hue, a line delay is necessary for QRY to 
remain matched with IBY. 

The amplitude format of the Y data is 8 bit, straight 
binary. The amplitude format of the IBY and QRY data 
is 8 bit, two's complement. The nominal Y output scale 
factor is one level per 0.394 IRE luminance unit. The 
nominal IBY output scale factor is one level per 1.102 25 
IRE subcarrier peak-to*peak unit times the cosine of the 
subcarrier phase angle. The nominal QRY output scale 
factor is one level per 1.102 IRE subcarrier peak-to- 
peak unit times the sine of the subcarrier phase angle. 

Built-in-Test— A built-in-test (BIT) feature 432 pro- ^ 
vides for the exercising and testing of the gamma mem- 
ories by the computer via the CI. Provision is also made 
for accepting a video test signal. This input is applied to 
the digitizing channels when the system is in the BIT 
mode. 33 

A Sync Control, and Test Generator (SCTG) 411 is 
depicted in its Visual System context. The SCTG 411 is 
the central source of sync, control, and test signals for 
the entire Visual System. Some of its output are from 
two of its functional entities, and NTSC sync generator ^ 
411(a) and a Master Clock 411(6). The Master Clock 
signals are derived from a crystal oscillator and are 
phase synchronized by a Color Field Reference pulse. 
The Color Field Reference is provided by the NTSC 
sync generator 411(a). The required clock outputs in- 45 
elude: 



(1) 4f 6 

(2) 3f 6 

(3) h 

(4) 5RFRMSYNC 



(about 14.3 MH,) 
(about 10.7 MHz) 
(3379545 MH, ± 10 H z ) 
(about 30 
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CELL PROCESSOR SYSTEM 



Described hereinbelow are requirements, operation, 
and interface characteristics of the Cell Processor Sys- 
tem (CPS) 312 portion of the Digital Picture Processor. 

The cell processor 312 receives the digital luminance 
and chrominance data corresponding to a scene from 
the Scene Storage System (SSS) 2S. Under software 
control it selects the portion which is visible to the pilot 
through one window, performs the geometric transfor- 
mation on this data as required by motion of the pilot's 
eyepoint, and generates analog red, green, and blue 
video signals for display. 

In summary, the output processor, comprising the 
Red-Green-Blue Generator 333, the special effects gen- 
erator 334, and the Line Buffer and D/A converter 335, 
receives data through the memory multiplexer 327. 
performs the conversion from Y,I,Q format to Red, 
Green, Blue (R, G, B) format, performs low pass filter- 
ing, simulates haze, and inserts a representation of sky 
above the horizon. It also provides for replacement of a 
limited number of pixels in the output scene with pixels 
supplied by the Visual Computer and for insertion of a 
light point surrounded by a black square for an auto- 
matic display position error sensing system. A data rate 
line buffer 336 is provided to increase the data rate, and 
allow time for flyback as required by the display. Fi- 
nally the R,G,B digital data streams are converted to 
analog signals, filtered and provided to the display 
along with a sync signal. 

In operation, the function of the cell processor system 
312 depends on a set of control and parameter words 
received from the Visual Computer 19 through the 
Computer Interface 329. 

A block of addresses is associated with the cell pro- 
cessor system 312. In addition, control words with 
unique addresses are provided for each CPS 312(a), (b), 
(c), (d). The computer 19 may communicate with a cell 
processor 312(a), (6), (c), (d), addressing a word or a 
block of words within the CPS address space. 

TABLE 2A 

Luminance address assignment to memory modules 



Computer Interface — The Computer Interface (CI) 
413 is the means whereby the Visual Computer 196 
interfaces with the Visual System. The interface 413 55 
provides an address bus, a 24-bit data bus, and control 
signals for the Visual Computer 19b to communicate 
with the Visual System. The CI 413 has a Data Acquisi- 
tion System (DAS) that includes D/A, A/D, and dis- 
crete I/O capabilities. The CI 413 is similar in concept 60 
to the interface for the Record System. 

Test Panel— A Test Panel (TP) 432 is included and 
provides the means for limited off-line mode manual 
testing of all the Visual System subsystems using the CI 
address and data buses. The TP 432 includes switches to 65 
set address and data for manual word-at-a-time commu- 
nication with any subsystem. Indicator lamps monitor 
the status of the address and data buses. 



Y ADDRESS 
BCD SEGMENT 


X ADDRES 


S BCD SEGM 


SSL- 






4.5 








0,1 


BOO 


BOl 


B02 


B03 


B04 


2,3 


B10 


BII 


B12 


B13 


B14 




B20 


B2I 


B22 


B23 


B24 


6,7 


B30 


B31 


B32 


B33 


B34 


8.9 


B40 


B41 


B42 


B43 


B44 



CHROMINANCE I ARRAY 



TABLE 2B 



Luminance addresi assignment to memory modules 
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•continued 



Y ADDRESS 
BCD SEGMENT 


XAI 


>DRES 


5 BCD SEOM 


ENT 


0,1 




4.5 




8.9 




0,1 


COO 


COl 


C02 


C03 


004 




CIO 


cu 


CU 


C13 


CM 


4*5 


C20 


C2I 


cu 


C23 


C24 




CM 


C3I 


C32 


C33 


C34 


8.9 


C40 


C41 


Oil 


C43 


C44 



YYQ 



CHROMINANCE Q ARRAY 



10 



15 



The Visual System Software Program supplies the 
line length (number of bytes of data per line) and the 
number of lines per zone. The number of lines per track 
(LPT) is suitably 120, 80, 60, 48, or, 40 and the number 
of luminance bytes per line (SLL) is suitably 1950, 2925, 
3900, 4875, or 5850 respectively making a total of 
234,000 luminance bytes per zone. These quantities 
depend on the scene data format which is chosen when 
the data is recorded on video discs. A Cardinal Sync 
pulse is generated each time the number of luminance 
bytes received is equal to an integer multiple of the 



TABLE 1 



Chrominance address assignment to memory modules 



BINARY SEGMENT 



BrnO BIT9 BITS BIT7 BIT6 BIT5 BIT4 
SELECTED LUMINANCE ARRAY MODULES 



X AND Y DIMENSION 

BCD SEGMENT ADDRESS FORMAT 

BIT3 BIT2 BIT! BITO SELECTED CHROMINANCE ARRAY 
X ADDRESS MODULES 



AOS. A 10, 
A01. All. 
A01 A 12. 
A03, A 13. 
A04. A 14, 
AOS, A 1 5. 
A06. A 16, 
A07. A 17. 
AOS, A IB. 
A09, A 19, 

A00. A0I, 
A10.AU 
A20. A21 
A30. A31. 
A40, A41, 
AM). A3 1. 
A60. A6I, 
A70, A71. 
AS0. AS1. 
A90, A91, 



A20, A30, 
A21. A31, 
A22, A32, 
All, A33, 
A24. A34, 
A25. A33. 
A26. A36, 
A27. A37. 
A2B. A38. 
A29, A39. 

A0Z A03, 
A12, A13, 
A22. A23, 
A32, A33, 
A42, A43. 
A32, A33, 
A62. A63. 
A72. A73. 
A82. A83. 
A92, A93. 



A4Q, A50, A60, 
A41, A51, A61, 
A42, A52, A62, 
A43. A53, A63. 
A44. A54. A64, 
A43. A55, A63, 
A46, A 36. A 66, 
A47. A57, A67, 
A4€. A 38. A68, 
A49. A59. A69. 



A 70, ABO, A90 
A71, A8I, A91 
A72, A82, A92 
A73, A83, A93 
A74, A 84, A94 
A75, A85, A93 
A76, A86, A96 
A77, A87, A97 
A78, A88, A98 
A79, A89. A99 



O 
0 
0 
0 
0 
0 
0 
0 
I 

1 



Y ADDRESS 



A04. AOS, 
A14, A13, 
A24, A23. 
A34, A3 5. 
A44. A43, 
A 54, ASS, 
A64, A65, 
A74, A75, 
A84. A65, 
A94, A95, 



A06, A07, 
A16, A17, 
A26, ATI. 
A36\ A37, 
A4&, A47, 
A56, A37, 
A66, A67, 
A76, A77, 
A86, A87, 
A96. A97, 



A08, A09 
A18, A19 
A28, A29 
A38, A)9 
A4fi, A49 
AS8, A59 
A68. A69 
A78, A79 
A88. A89 
A98, A99 



0 
0 
0 
0 
0 
0 
0 
0 

I 
1 



0 
0 
0 
0 

I 
1 
1 
I 

0 
0 



BOO. BIO. 
COO, CIO, 
B01, Btl. 
COI.Cll. 
B02, B12. 
C02, CI 2, 
B03, B13, 
C03, CI 3, 
B04, BU, 
C04, CI4, 

BOO, B0 1. 
COO, COl, 
BIO, Bl 1 , 
CIO. CU, 
B20, B21, 
C20, C21. 
B30. B31, 
C30, C31, 
B40, B4t. 
C40.C41, 



B20, B30, B40 
CM, C30. C40 
B21, B31. B41 
C21, C31, C41 
B22, B32. B42 
C22, C32, C42 
B23, B33, B43 
C2J, C33, C43 
B24, B34. B44 
C24, C34, C44 

B02, B03. B04 
002,003. C04 
BI2. B13, BI4 
C12, CI3. C14 
B22, B23. B24 
C22.C23. C24 
B32. B33. BJ4 
C32, C33. C34 
B42, B43. B44 
C42. C43. C44 



All control and parameter words using during normal 
operations are double buffered. The computer commu- 
nicates with a first-rank buffer in the control system 328 45 
(FIG. 23) at any time except during a transfer interval 
which occurs during the vertical blanking time between 
frames (30 Hz). The transfer to the second-rank buffers 
is initiated by a frame synchronization signal from the 
VDS. The words that are not double buffered in this 50 
way are those associated with the Cell Memory on-line 
BIT operation. Double buffering of these words is 
avoided so that the speed of this test mode is not limited 
by the 30 Hz transfer rate. 

Each of the four input interpolators 321(a), (6), (c), 55 
(d) f receives digital video from the SSS and processes a 
portion of it for storage in the Cell Memory. Referring 
to FIG. 24, each interpolator consists of two channels 
344. 345, one for luminance and one for chrominance. 
The SSS is organized as tracks or tones with each zone 60 
having a storage capacity of 327,680 (10x21*) bytes of 
which 312,000 bytes are utilized. Each zone contains 
multiplexed luminance and chrominance data arranged 
in lines according to the following format: 

65 



Y Y I 



N (even line) 
N+l (odd line) 



Y YYI.. Y 
YYYQ...Y 



number of bytes per line. The Cardinal Sync is thus the 
start-of-long line sync signal. 

A data separator 346 (FIG. 24 A) demultiplexes the 
incoming data from the SSS into luminance and chromi- 
nance streams. The luminance stream consists of a maxi- 
mum of 5850 bytes for each line. The chrominance 
stream consists of a maximum of either 1950 bytes of I 
data or 1950 bytes of Q data for each line. 

The operator Z~ 1 represents a delay of one line. The 
function of these filters 347(6) is to provide smoothing 
between lines. The values of the parameters FCLTF 
and FCCTF control the amount of smoothing for lumi- 
nance and chrominance. If these values are zero no 
smoothing occurs. These filters utilize a RAM for accu- 
mulation of one line of data. Each RAM has a storage 
capacity of 8192 bytes for Y (luminance) or a combina- 
tion of 4096 bytes each for I and Q (chrominance) data. 
Since the output depends on the input of several succes- 
sive lines, each interpolator processes zones in order of 
increasing line number. 

Each interpolator is equipped with two low pass 
filters 348(a), (b) to provide filtering in the longitudinal 
direction. One operates on Y (luminance) data, and the 
other operates on multiplexed I and Q (chrominance) 
data. The response of each filter follows one of four 
curves which is selected by a control word (FVLLF or 
LVCLF) from the Visual System Software Program. 
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Longitudinal interpolators 349(a), (b) generate new 
data streams at intervals of DELXL and DELXC (in 
units of the input sample spacing). These parameters 
range between $ and 16. DELXL is the luminance out- 
put sample spacing, and DELXC is the chrominance 5 
output sample spacing. These parameters are supplied 
by the visual software as an integer part and a fractional 
part. To insure an accuracy of i for 1280 samples, the 
fractional portion of these variables is specified with 
12-bit numbers. The Visual System Program provides iq 
the same values to all four interpolators. Since the data 
from the SSS is formatted as streams with one chromi- 
nance value for every three luminance values, and since 
the Cell Memory chrominance X -address range is one- 
half of the luminance X-address range, the Visual Sys- 15 
tern Program insures that DELXL =8 DELXC. 

The program also supplies a sweep delay number i.e., 
the number of bytes from cardinal sync to the leading 
edge of the video segment to be interpolated, and the 
length of the line (number of pixels per line) to be writ- 2 n 
ten in the Cell Memory. 

The new data stream consists of a linear combination 
of the two values nearest the desired point The coeffici- 
ents are J, i, or j and depend on the position of the 
desired point as shown in FIG. 25, wherein the nature 25 
of "A" and "B" represent the value from the longitudi- 
nal memory, of filtered data from the scene memory, 
and wherein points 350, 351, and 352 are defined respec- 
tively, by the following relationships: 

X(350)=(i)X^+(J)X fl 30 

X(351)=(|) X,+(|) X B 

X(352)=<4) X4+H) Xg 

35 

Wherein X is the values derived from the longitudinal 
filter 348(a). 

Transverse interpolators 354(a), (b) generate new 
data streams corresponding to an output line spacing 
DELYL and DELYC (in units of the input line spacing) 40 
for luminance and chrominance respectively. These 
parameters are supplied by the Visual System Software 
Program and range between i and 8. DELYL is the 
luminance line spacing, and DELYC is the chromi- 
nance line spacing, and the same values are supplied to 45 
all four interpolators 324(a), (b), (c), (d). In order to 
maintain registration between luminance and chromi- 
nance, these two parameters are equal if the cell mem- 
ory chrominance Y address range is one-half the lumi- 
nance Y address range. Values at the points on the new 50 
line are determined by linear combinations of nearest 
lines with coefficients of J, i, and 3 as in the longitudinal 
interpolator 349(a). The visual system software pro- 
gram also supplies a luminance and a chrominance off- 
set for each interpolator track 320(a), (b), (c), (d). These 5 5 
quantities specify spacing between the first interpolator 
output line and the first interpolator input line in units of 
output line spacing. 

The Cell Memory circuit 326 (FIG. 23) stores the 
digital information that is sent to the output processor ^ 
333, 334, 335, 337. The data to be stored consists of 
luminance (Y) and chrominance (I and Q) byte streams 
from the input interpolators 324(a), (a), (c), (a> The Cell 
Memory 326, as discussed above is comprised of two 
identical sections 325(a), 325(a), henceforth referred to 65 
as Cell Memory Sections. Luminance and chrominance 
data may be alternately written into one section and 
read from the other. Each Cell Memory Section 325(a), 
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(a) is organized so as to be capable of storing data from 
up to four separate input interpolators 324(a), (6), (c), 

Each Cell Memory Section 325(a), (a) contains one 
1280X1280 array of byte storage locations for lumi- 
nance data and two 640 x 640 arrays of byte storage 
locations for chrominance data. Total storage is thus 
2,457,600 bytes for each section. The cell memory sec- 
tions 325(a), (b) are described in more detail hereinbe- 
low. For addressing purposes the luminance portion of 
each Cell Memory Section is organized as a 10 X 10 
interleaved array of memory modules (as shown at 500 
in FIG. 31). Each memory module is organized as a 
128 X 128 byte array. This creates a I280X 1280 address 
space. The chrominance portion of each Cell Memory 
Section 325(a), (a) is organized as two identical 5x5 
interleaved arrays of memory modules, one array for I 
data and one array for Q data. The memory modules are 
identical to those in the luminance array. 

The Cell Memory 326 is capable of operating in three 
distinct modes under external control: Read Mode, 
Write Mode, and Refresh Mode. While one Cell Mem- 
ory Section is in the Write Mode, the other section is in 
the Read Mode. The Refresh Mode is utilized in both 
the Read and Write modes to preserve the contents of 
both Cell Memory Sections. The implementation of 
refresh in the Write Mode is dependent on the timing 
required to accomplish scene-to-interpolator data trans- 
fer. No attempt is made to preserve stale data in the Cell 
Memory 326 after a shift from the Read Mode to the 
Write Mode. Refresh is accomplished on a "picture 
line" basis in parallel with normal write operations; i.e., 
while some modules are being written into, others are 
refreshed using the same X dimension address. Refresh 
rate is programmable to vary between once per line and 
once per eight lines as the "picture line" varies in 
length. A control word from the computer 19 specifies 
the refresh rate. 

A Built-in-Test (BIT) function for cell memory 
under control of the computer 19 is provided. On-line 
and off-line testing is possible. For on-line BIT, a block 
often bytes of luminance data and five bytes of chromi- 
nance data is written in or read from the cell memory by 
the computer. In this mode the starting address is speci- 
fied by the computer 19, and the data is stored in or read 
from sequential locations addressed by incrementing the 
X-address. The two memory sections are tested inde- 
pendently'. 

Off-line BIT consists of loading the Cell Memory 
with hardware-generated data patterns during a write 
cycle and verifying that the memory contents conform 
to the chosen pattern during a read cycle. Off-line BIT 
pattern selection and read-and write-cycle initiation is 
controlled by the Visual System Software Program. 
During write operations, the Cell Memory section is 
treated as four segments with starting Y-addresses of 0, 
320, 644), and 960. Each segment has its starting X- 
address at zero, and write rates are high enough to 
satisfy refresh requirements. The write sequence will fill 
every memory location in each Cell Memory segment 
325(a), (6) and then initiate a refresh sequence to retain 
the data. 

The off-line BIT data-pattern generator, not shown, 
has four modes of operation. Alternate loading from 
two registers (ALT) utilizes two data words initially 
loaded from the diagnostic program, and SWEEP UP 
and SWEEP DOWN utilize outputs from a counter. 
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SHIFT utilizes loading a shift register which is then 
shifted serially in ring fashion. Off-line BIT status is 
reported using the four output status words. 

Address streams are provided to the Cell Memory. 
One is for writing data from the input interpolators, and 
one is for reading data to the output processor. The read 
addresses generator is shown as block 330 in FIG. 23, 
and the write addresses generator comprises a portion 
of the memory segments 325(a), (b). The addresses uti- 
lized by the Cell Memory 326 during the write mode are 
generated by counters in the Cell Memory interface 
circuit and are controlled by signals from the interpola- 
tors 324(a), («, (c), (<*). 

In the write mode, a common X address is provided 



10 



used in the high-speed address generator to generate the 
cell memory read address while the corresponding re- 
gion is read. 

If a pixel lies in the interior of a particular one of the 
above defined regions, the associated matrix will be 
used, but if a pixel is outside of all regions, the last valid 
pixel will be repeated until a new region is selected. If 
two regions overlap, then the one with the smallest 
label (e.g.; the "nearest- or highest priority) will be 
selected. Thus, the data will be organized such that 
region 1 is the one which is near the eycpoint— region 2 
behind region 1, etc. The edge detectors region are 
shown in FIG. 27. 
The Hardware design for four regions, (as part of the 



to all modules of the luminance and chrominance array 15 ^toens generators 330 as shown in FIG. 26 (parameters 

portions of the memory segments 325(a), (6), simulta- - 

neously. The input interpolator sets the X-addresses to 
zero before a line is written by generating a reset signal. 
During a write cycle (14 periods of a 14.3 MHz clock) 

ten bytes of luminance data and five bytes of either l or 20 tnTread-acWi^ pipeline at least every third pixel. The 
Q data are written from each input interpolator which y ^ 

has valid date. The X address is then advanced to the 
next block of ten modules for luminance and the next 



for 16 lines and four sets of matrix elements) is illustra- 
tive of the implementation. 

The edge detector and region select circuit 360 oper- 
ates at a frequency of at least 7.16 MHz (2fs) updating 



block of five modules for chrominance unless a reset is 
generated by the interpolator. 

Twelve separate counters are provided for each sec- 
tion of Cell Memory to generate the Y write addresses. 
These counters are set to the Y -address of the first line 
to be written during a frame. At the beginning of a 



25 



frame, four luminance starting addresses supplied by the 30 every display frame time. 



address circuit 330 includes a raster generator circuit 
361 for generating a scan raster pattern. 

The matrix selected by the region selector 360 de- 
pends on the position and orientation of the pilot's eye- 
point. This matrix represents a combination of rotation, 
skew, and other distortions of the original scene in map- 
ping a part of that scene into a display window screen. 
The matrix is computed anew by the software program 



Visual System Program are loaded into the four lumi- 
nance counters, and four chrominance starting ad- 
dresses are loaded into the eight chrominance counters. 
During interpolation, these twelve counters are inde- 
pendently incremented under control of the interpola- 
tors. These counters are advanced on the completion of 
writing of one line of the cell memory. 

The read addresses generator system 330 generates an 
address stream utilizing the Cell Memory 326 to read 



This matrix is output to the high speed address gener- 
ator 363 and is used to generate the vector 
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A matrix memory 362 stores the A parameters, and, 



data to the output proctor 333, 334, 335, 336 for dis- „ ^™h™ 

play. A point on the display screen is represented by W «£J ™ ™ m ... e * , . MMfftr ui undei 



play. A point on the display 

(Q, YpLf Zpl) where C,is the normal distance from the 
pilot's eyepoint to the origin of the screen, and Y«, and 
Z/>/. are the raster addresses: 

-383£Y/>l^3«5 (fasi sweep) 



mation into the high speed address generator 363 under 
the control of the edge detector 360. Next a unit vector 
is generated by the equation 



45 



(slow tweep). 

The point (C„ 0, 0) corresponds to the origin of the 
screen. 

Edge Detector/Region Selector— The raster may be 
divided into at least four ordered regions with labels 1, 
2, ... 4, each bounded by four straight lines on the 
display defined by equations of the form (one equation 
for each bounding line): 

Yrt.-±<A+BZ/>£) 



50 



-0 0 



0 */ 



where R* = P + r 2 + Z 2 

Since (X& Y Et Ze) is independent of the scale of 
55 Ye, 2e), the matrix A may be multiplied by a constant 
multiplied by the identity matrix. This constant is 
chosen so that 



where Yw.and Zp£.are the fast and slow scanning pixel 
address of the display raster, respectively. See FIG. 26 60 
and FIG. 27. 

The parameters A and B and the overall sign are 
supplied by the Visual System Program for each line. 
The separate, bounded regions correspond to regions of 
the scene which will be given different distortion pro- 65 
cessing during maneuvers of the simulated aircraft, for 
correction of visual perspective. A 9-element matrix 
associated with each of the above defined regions is 



The matrix elements A 12, A 22, A 32, An, A23. and A33 
and the products AnC$, A21QS, and A3iCs for each 
active region are supplied by the Visual System Soft- 
ware Program. The point on the unit sphere, FIG. 9 
defined by (X& Yf, Ze) is mapped into the Pseudo- 
Film plane by the transformation 
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These quantities lie between approximately — 2.2 and 

+ 2.2. 

From these coordinates, the address in the Cell Mem- 
ory 325(a), (b) is obtained by the equations 

The cell bias (Kb and Yjj) and the cell gain (Kjr and 
Ky) are supplied by the Visual System Software Pro- 
gram and are constant during a frame. The cell bias and 
cell gain values are typically the same for all regions. 

Output Processor— The output processor 333, 334, 
335, 336, is organized as a pipeline (see FIG. 28). Three 
serial byte streams 365(a), (b), (c), (d) t FIG. 28, of Y.I.Q 
data are received from each Cell Memory section 
325(a), (b) at a rate of 21.47 MByte (6f B ) for each 
stream. These data are sequentially processed by the 
subsystems: Multiplexer 366, Low Pass Digital Filter 
367, Red, Green, Blue Decoder 368, Point Insertion 
369, Haze and Sky Generator 370, Position Error Sens- 
ing 371, Date-Rate Buffer 372, Digital-to-Analog Con- 
verter and Low Pass Filter 373, Display Multiplexer 
374. 

Multiplexer — The memory data multiplexer 366 is 
controlled by a select signal from the computer inter- 
face which selects the section of memory 325 which is 
read. A control signal which originates in the region- 
select portion 360 of the read address generator 330 
indicates when a pixel must be repeated. When this 
signal is true the last value read from the cell memory is 
repeated and sent to the low-pass filter 367. 

Low-Pass Digital Filter— The filter circuit 367 al- 
lows the selection by a computer control word of the 
transfer function 1 or 

hi+kz'+z- 1 )) 

for each of Y,I, and Q. This filter replaces each pixel 
with the average of itself and the average of the two 
nearest neighbors. It rolls off to 6 db at 5.4 MHz and has 
a linear phase response (see FIG. 13). 

Red, Green, Blue Decoder— The function of this 
section 333, 368 is to evaluate the equation, 



15 in 



Additional factors are included to reduce light levels 
for simulation of low-light flight conditions and to cor- 
rect for color balance errors in the data base. The offset 
term B/ enables the software to add a red, green, or blue 
5 bias to the output video. 

Point Insertion — Circuit 369 is provided to generate 
up to 20 points. These points replace the stored scene 
information at their respective locations. The position, 
color, and intensity of each is determined independently 
10 by the Visual System Program. The position (Y^, Z 0 ) of 
each is determined to i pixel accuracy (1 1 bits for Y and 
11 bits for Z). 

Each point consists of one, two, or four pixels de- 
pending upon whether its location has integer or half- 
integer coordinates. When multiple pixels are utilized, 
the computer 19 makes a corresponding reduction in 
intensity (divides by approximately I or 4) depending 
upon the pedestal level and display response function. 
The hardware allows two or more points to be in adja- 
20 cent pixels, if desired, in order to simulate nearby lights. 
If the Y portion of the light point location in the display 
raster is a whole number, a pixel will be activated when 
Y = Y<, 

If the Y position of the light point location is a half- 
integer, pixels will be activated at Y=Y and Y=Y a + 1. 

Haze and Sky Generators — The sky generator system 
370 simulates a diffuse sky above a line approximately 
10 above the horizon. The haze generator simulates fog 
by reducing the intensity of the video from the cell 
memory and adding a fog luminance. These two func- 
tions are considered as a single system because they 
both utilize the function COS 4> where $ is the angle 
between the pilot's line-of-sight and the earth vertical. 
The hardware which generates COS <f> is shared by the 
sky and haze generators (see FIG. 14). 

Sky Generator — Referring additionally to FIG. 29, 
when a display pixel corresponds to a position above a 
line approximately 10* above the horizon, a sky register 
375 generates a constant video value to simulate a dif- 
40 fuse sky, and when the position is below this line data 
from the cell Memory is displayed 325. The position of 
this line and the color of the sky are determined by the 
Visual System Software Program. The Visual System 
Program supplys the Y and Z components of a unit 
45 vector (X* Y„ Z,) with 

l « jr r * + r r * +. z? 
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which is directed downward in a coordinate system in 
50 which the X-axis is directed from the Pilot's eyepoint to 
the origin of the display screen, and the Y-axis is parallel 
to the display fast scan direction of the display. If 0 is 
the angle between the line-of-sight and the vertical, then 



where Y,I, and Q are data streams received from the 55 
low pass filter 367. A,yand B, are values received from 
the Visual System Software Program which are con- 
stant during one frame. The matrix A/yis the product of 
several factors. If the luminance and chrominance low 
pass filter 367 gains at zero frequency- are Gl and -Go 60 
then the above matrix must include a factor 



l/G/,0 0 
0 1/G C 0 



l/C C 



Cos <fr = 



where Ypl and ZpL are the display raster pixel coordi- 
nates, and Qis the distance from the pilot's eye point to 
the origin of the screen. 
65 The quantity COS <J> is compared with a parameter 
COSPH supplied by the Visual System Software Pro- 
gram to determine whether diffuse sky or cell memory 
data is to be displayed. If COS ^ is less then COSPH, 
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then a diffuse sky is generated. The Visual System Pro- 
gram also supplies the coordinates of the electrical cen- 
ter of the raster as derived from the position error sens- 
ing data. 

Haze Generator— Referring to FIG. 29, the effect of 
haze in the atmosphere is simulated by replacing a frac- 
tion of the video signals (B x ) with a signal B's generated 
by adding a fraction of the original signal to a fog lumi- 
nance (Bp) according to the equation 

ffs ~ RB S + (1 - *>B F 

where B, and B's represnt the red, green, or blue data 
streams. Here R is a contrast ratio which depends upon 
the line of sight distance through the fog L and the 
extinction coefficient E. 



10 



15 



0 for lero visibility 
v t for clear atmosphere. 



20 



Bf has three components: red, green, and blue which 
are constant and are determined by the Visual System 
Software Program. 

A uniform layer of fog with extinction coefficient E 25 
and thickness Hf is assumed to exist above and below 
the eyepoint. The extinction coefficient E is defined 
such that the contrast ratio is 1/e when the line-of-sight 
distance through the fog is 1/E. Then the viewing dis- 
tance through the fog is L = H//|COS <f>| and the con- 30 
trast ratio is R = EXP (-EL)=EXP(-EHf/|COS 

The Visual System Software Program generates the 
quantities E and Hf which are only used in the combina- 
tion ExHf. Since this product varies from zero to 35 
infinity, the hardware makes a change of variables in 
order to efficiently utilize PROM look-up tables. As a 
result, the Visual System Software Program supplies 
the parameter 



40 



K = log 2 {EHfr 



Display Position Error Sensing System— An error 
sensing circuit 371 is provided to insert a Red area cen- 
tered in a black square into the display raster. The posi- 
tion is controlled to an accuracy of one pixel by words 
received from the Visual System Computer. The size of 
the Red area is one pixel and the black area is a square 
32 pixels on each side. The intensity is controlled by a 
word from the Visual System Program. 

Data-Rate Buffer— A buffer 372 is provided with 
capacity of two lines of red, green t and blue data 
(2KX24 bytes). One section is loaded at 21.47 MHz 
while the other is read. at 24.54 MHz (48/7 hi .Since 
ZUS of the 38 US line time is used for cell memory 
refresh, data to be loaded into one section is available 
for 36 US per line. During this time interval 770 words 
are loaded. Data is read from the other section during 
the active display time of 31 US. The interval between 
bursts of data from the cell memory are delayed as data 
passes through the output processors circuitry. This 
interval overlaps the display blanking time. During this 
interval overlap, read/ write mode is switched between 
the two sections. 

Digitai-To- Analog Converter and Low-Pass Fil- 65 
ter— Three identical channels of a D/ A conversion and 
filter circuit 373 are provided for the red, green, and 
blue signals. The input to each is the output of the data- 
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rate buffer. After the conversion to analog feum, the 
signal is filtered to remove components above die Ny- 
quist frequency. 

Control For Computer Interface— Communication 
between the CPS 312(c). (J>), (c\ (d) and the Visual 
System Computer 19 Universal Block Controller is 
provided by the Computer Interface (CI) 300 (FIG. 21) 
which is located in the Video Digitizer System (VDS). 
A common bus 329 (FIG. 23) connects each CPS 312, 
the VSS 28, the VDS 195 and the SSS » to the Com- 
puter Interface. This bus consists of a twenty-four bit 
wide bidirectional data bus, an address bus, and control 
and handshaking signals. The computer interface con- 
trol circuits 306 are suitably distributed over four circuit 
boards, one in each card cage. One card serves as a 
master by furnishing the communication path between 
the CI and the other three cards. All control, handshak- 
ing, CPS enable, and self-test functions are on this card. 
Addresses received from the CI are decoded and 
mapped into subsystem addresses and sent along with 
data and control signals to the other card cages. The 
subsystem addresses are further decoded within each 
card cage. 

All data, addresses, and control signals are trans- 
ferred between card cages by differential line drivers 
and receivers and between cards within a single card 
cage by single-ended signals. All timing signals for the 
cell processor circuits are derived from a 14.3 MHz 
(4f*) clock signal and a 30 Hz frame synchronization 
signal supplied by the VDS. 

The data-rate buffer, the digital-to-analog converter, 
and the display sync generator require a 24.545451 MHz 

(48/7 f£0 dock signal. This isdcrindfnm tkt 14.3 MHz dock by 

a phase-locked loop. The interpolator and memory 
require 14.3 and 21.5 MHz (6fa) clocks. These are de- 
rived from 128.86362 MHz (36« clock signal which is 
derived from the 14.3 MHz clock by a phase locked 
loop. 

CPS External Signal Interface— The Cell Processor 
System interfacing signals (Reference FIG. 1) are as 
follows for CPS number zero. For CPS numbers one, 
two, and three, all signals which have CEO as part of 
their name will have that portion replaced with CE1, 
CE2, or CE3 respectively. 

With respect now to the configuration of the high 
speed memory segments (of which the first segment 
325(a) is typical) capable of reacting to the "line random 
address sequencing/' each memory segment 325(a) con- 
tains a luminance, chrominance I and chrominance Q 
section for storing luminance and chrominance I and Q 
information. FIG. 37 is representative of the luminance 
array, and tables 5 and 6 are representative of the chro- 
minance I and Q arrays. The data to be stored will, as 
suggested above, consist of luminance (Y) and chromi- 
nance (I and Q) byte streams from the scene to cell 
interpolators. Data will be stored in sequential memory 
locations under control of the write address generator 
at a maximum transfer rate of 40.8 MBytes/Sec. The 
luminance and chrominance data may be read from the 
Cell Memory in a line random manner under control of 
the read address generator at a maximum transfer rate 
of 21.5M Bytes/Sec. See FIG. 1 

Cell Memory Organization— The Cell Memory 
(FIGS. 23, 36) is comprised of two identical sections, 
(325(a), 325(6), henceforth referred to as Cell Memory 
sections of 2.46M Bytes each. Luminance and chromi- 
nance data are alternately written into one section and 
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read from the other. Each Cell Memory Section is orga- « f ■, w r-s ^ * ^ 

. . # . wir* j/f t Write Mode— Data to be stored in a Cell Memory 

n.zed so as to be cabbie of goring ^ datafrom four sepa- 3 from J 

rate sources (tracks 218(a). {«. (r) «/), FIG. 22) s.multa- te Simultaneously. Each of the 

neously. Memory interleaving techniques are employed four purees present luminance and chrominance I and 

to attain the required data transfer rates in both the read q data f or storage in the appropriate array. Data is 

and write modes of operation. Multiplexing of clocks, formatted in such a way that multiple bytes from each 

addresses, and input and output data to the two sections source may be stored simultaneously in all the accessed 

of the Cell Memory is accomplished externally to the memory locations sharing a common 7-bit binary X 

Cell Memory proper. I0 dimension address. 

Cell Memory Section Organization— Each Cell Read Mode— In the Read Mode the Cell Memory 
Memory Section contains one 1280X 1280 array of byte Section accepts addresses from the Read Address Gen- 
storage locations for luminance data and two 640x640 erator and, after a fixed delay, outputs the byte of lumi- 
arrays of byte storage locations for chrominance. Total nance data and two bytes of chrominance data (1 and Q) 
storage then is 2,457,600 bytes for each section. 13 corresponding to that address. In general, the addresses 

Luminance Organization— Referring to FIG. 37, for cause modules in the memory arrays to be selected in 

addressing purposes the luminance portion of each Cell " linc random" as the translated and/or rotated scan 

Memory Section is organized as a 10X 10 interleaved patterns of the original scene are generated by the Read 

array of memory modules. Each memory module. 500 is _ Address Generator. The Cell Memory module design 

organized as a 128X128 byte array. This creates a 20 'f 0reS raul ^ f le ac f esses t0 lhe m0dule sH ° M 

1280X 1280 address space. One address for one of the S^^S^ * 

memory modules 500 is represented in FIG. 38. 0utput Data Multiplexing-Output data from the 

Luminance Addressing-The luminance portion of luminance and chrominance memory modules are syn- 

each Cell Memory Section is addressed by an 11 -bit 25 chronized to a common clock. Insofar as possible, mul- 

address for the X dimension and an 1 1-bit address for tiplexing of the output data onto common data lines to 

the Y dimension. Each 1 1-bit address consists of a 7-bit create luminance and chrominance data sequences cor- 

binary segment in the most significant bit positions and responding to the input address sequences is accom- 

a 4-bit binary-coded-decimal (BCD) segment in the plished internally to the Cell Memory. 

least significant bit positions. The BCD portions of the 30 Refresh Mode— The Cell Memory retains the integ- 

X and Y addresses are decimally decoded to yield 10 Y ritv of stored data if every address in the X dimension in 

select strobes and 10 X select strobes to uniquely iden- f hc ,ummanc€ . and chrominance arrays is accessed at 

ufy one of the 100 memory modules 500, FIG. 37, in the least «* tunc m ^ }° f^***"* period. External 

10 X 10 array. The two 7-bit binary portions of the X&Y „ V f ^ * ^ u ^ 

, . J , „ . ., 'v. r A , . 35 ory Section which is in the Read Mode and multiplies a 

addresses are used to uniquely idenf.ty one of the byte rcfresh onlQ the x dimcnsion stress bus at 

storage locations in the 128 X 128 array in each memory ^^ic intervals with a frequency sufficient to guaran- 

module. The decoding of the BDC portions of the X tee a complete sequence of X addresses during each 2.0 

and Y addresses is performed externally to the Cell millisecond interval. The Cell Memory Section receiv- 

Memory proper. 40 ing the refresh command inhibits non-essential internal 

Chrominance Organization — For addressing pur- operations wherever possible to limit power dissipation, 

poses the chrominance portion of each Cell Memory The refresh rate for the Cell Memory Section which is 

Section is organized as two identical 5x5 interleaved in tne Write Mode is dependent upon the rate at which 

arrays of memory modules, one array for Q data and daU ls stored; i.e., as the input data rate slows down, the 

one array for I data. The memory modules are identical 45 frequency of Refresh Mode operations increases. The 

to those in the luminance array, each module containing ^ ntc Address Generator causes Refresh Mode opera- 

a 128X 128 array of byte storage locations. Tables 2A U ,°f w,th a frequency sufficient to guarantee a com- 

j 2B plete sequence of X addresses during each 2.0 millisec- 

, ond interval. 

Chrominance Addressing— The X and Y addresses $q 

for the chrominance I and Q arrays are derived from the IMPLEMENTATION 
respective luminance addresses. The 7-bit binary por- Cell Memory Module— The memory module 392, 
tions of the luminance X and Y addresses are used with- FIG. 39, is the primary building block of the Cell Mem- 
out modification to uniquely identify one of the byte ory. Each module has a storage capacity of 16,384 bytes 
storage locations in each module. The 4-bit BDC por- 55 of data(l byte =8 bits). Each byte of data is individually 
tions of the luminance X and Y addresses axe used to addressable by means of a 14-bit address. The memory 
uniquely identify one of the 25 memory modules in each module is organized as shown in FIG. 39. 
5x5 array, per Tables 2A and 2B. The address assign- Module Storage Elements— The storage elements 
ment to modules is illustrated in Table 1. 394 for all Cell Memory modules arc metal oxide silicon 

Cell Memory Operation-The Cell memories 325(a), 60 £J°5> ™*<>^ 
(bl FIG. M, are capable of operating in three distinct ? f T^^Vll ST^? 00 ^ 

modes under external control: Read Mode, Write ^ u i ? * A ' T? ^ 

w j jo* u w j ««_•. Z^T», each). Each individual element has a cycle time not to 

Mode, and I Refresh Mode. While one Cell Memory cxcced 280 nanoseconds . Each memory module utilizes 
Section 325(a) is in the Write Mode, the other section « g individual storage elements 394 for a total storage 

325(A) shall be in the Read Mode. The Refresh Mode is capacity of 131,072 bits. 

utilized in both the Read and Write Modes to preserve Module Input Signals— The input signals to each 

the contents of both Cell Memory Sections. module 392 consists of 8 bits of input data. 14 address 
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bits organized as 7 bits of Y dimension address and 7 bits input to a low logic level with the timing relationship 
of X dimension address, and timing and control signals. shown in FIG. 50. It is at a high logic level during the 
All inputs are in the form of TTL logic levels. Read and Refresh Modes- 

Module Clock Input— The Memory module is capa- Wrcasin Command— This active low signal is used 
ble of operating with two distinct clock frequencies, 5 during the Write Mode to generate multiple memory 
one for use in the write mode and one for use in the read storage sequences when executing Page Mode Write 
mode. The rising edge of the clock input signifies that a Cycles. It must be at a high logic level during the Read 
new set of addresses and module select signals (X and Y w $ Refresh Modes and any portion of a Page Mode 
strobes) is to be presented to the module inputs 395. The Write Cycle during which data storage is to be inhib- 
falling edge of the clock shall signify that these inputs 10 itcd 

are stable at the module inputs. The falling edge of the i nput Data— During a Page Mode Write Cycle there 
clock differs by no more than ± 10% of the total clock m four timc mtCTV als during which the input data may 
period for a nominal 50% duty cycle. ^ stored at an associated Y dimension address. The 

Read and Refresh Mode Clock— The module oper- mo dule may store up to four different input data bytes 
ates in the read and refresh modes with a clock fre- 15 at f our different Y dimension addresses during one Page 
quency 6 times that of the color burst frequency of 3.579 Mode Write Cyc j Ct xh c y dimension address and the 
MHz, or 21.474 MHz. This yields a clock period of - m dalfl timi requirements are identical at the mod- 
46.56 nanoseconds. Six periods of this clock is 280 nano- uIc fa ^ . data h represented m positive true 
seconds, which is the required minimum cycle time of f onna r piG 50 

each memory module. The timing relationship shown in 20 memory modu]c circuit is shown in greater detail 

FIG. 49 illustrates the read mode timing cycle, wherein A memory cycle is initiated when both Y 

line 560 dock trobe/ and X strobe/ are at a LOGIC LO level. Stor- 

Write Mode Oock-The module opera es in he ^ (b) (c) rcccivc ^ m » « refrcsh 

write mode with a 'lock f^«w 4 times that of die "^0^ in" and «x address" and "write" 

at this clock frequency. The timing cycle is shown in «♦ to *el«X 1 ™™W ch P **™*" C °™ 

FIG. 50. wherein line 561 represents the 14.318 MHz 2 o™ds « W f^JKSSflS^IS^NS 

timina evele 568(a), and through storage register 569 to inok 
X Address" Inputs-The 7 bits of X dimension address 30 gate 570 to the RAS input of the memory chip 565 
are stable at the module inputs prior to the falling edge clocking signals are fed through storage register 572 
the clock and remain stoUe after the rising edge of with the WRCASIN input, through NAND gate circuit 
the clock for a minimum of 4 nanoseconds. The X ad- 573 to the CAS input of the memory chip 565. 
dress is in negative true format (inverted) at the module Control Signals— During the write mode these con- 
inputs 395(c), with one level of inversion taking place 35 trol signals are in the states shown: 
internal to the module. 

Y Address Inputs— During the read mode of opera- REFRESHIN/: LOGIC HI 
tion the 7 bits of Y dimension address are stable at the Y 

address latch inputs with respect to the clock. During WRITEIN. LOGIC HI 

the write mode of operation the Y address is changed. 40 

The Y address is in negative true format (inverted) at Circuit Operation-A memory cycle is initiated when 

the module inputs with one level of inversion taking both Y STROBE/ and XSTROBE/ are at a LOGIC 

place internal to the module. LO level when the clock goes LO. Signal MI goes HI, 

X and Y Strobes— Referring to FIG. 50, the X and Y latching the addresses and the first byte of input data 

strobes are derived from the BCD portion of the Cell 45 ^ setting NOR gate latch output LATCH/ to a 

Memory X and Y addresses and function as module LOGIC LO. At the rising edge of the first clock the flip 

select signals. The strobes are stable at the module in- flop ^ DL s to a LOGIC HI, initiating the RAS/. 

puts prior to the falling edge of the clock and remain Aftef 39 nanoseconds the RAM address is multiplexed, 

stable until the rising edge of the clock. The correspon- After the of nejU c j ock( HOLDITIN/ goes 

dence of both strobes being of a low logic level with the 50 LQ resulting in RAS/, MUXIT/, and MI being forced 

above timing constraints indicates module selection and LO Vor the duration of HOLDITIN/. The second clock 

causes a memory cycle to be initiated. ^ rcsu|ts in ni flop olltput WRCAS going HI, which 

Write Command-The write command signal being iniliales the first CASA Delay | me output RESET 

of a high logic level at the module input causes the ^ ^ NQR , atch tQ rcsct and DLS %Q ^ ^ 

memory module to enter the write mode of operation. 55 LQ ^ ^ dock ^ foufth dock causes 

A low logic level indicates that either a read mode or WRC X S to go LO , which terminates the first CAS/ 

refresh mode is desired. Level changes at the wn e ^ and ^ by 

selected. The refresh command is at a high logic level the fifth clock wh.ch also unties another CAS/. Th. 

during the Read and Write modes. Level changes at the sequence ^continues for up to four CAS/ eye e* after 

refresh command input only occurs when the module is wh.ch HOLDITIN/ goes HI m preparation for anothe 
in an inactive state. 65 complete memory cycle. ExterMl c.rcu.try can control 

Holditin Command-This signal is used during the which, .f any. of the four possible CAS/ cycles are 

Write Mode of operation to cause the memory module actually utilized to store data by controlling the state of 

to execute a Page Mode Write Cycle by taking this WRCS1N/ during the appropriate time also. 
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Cell Memory Module Operation— This paragraph one select strobe which is unique to it and one strobe 
explains the operation of the cell memory module cir- which is common to the other four modules, 
cuit. A timing diagram of events is shown in FIG. 49. PWB Input Signal format— Referring to FIG. 41, 

Control Signals — During the read mode these control input signals to the PWB be in differential form. The 
signals are in the states shown: 5 PWB input circuits represent one load to each input 

line. 

REFRESHING LOGIC HI PWB Input Interface Circuit— Referring to FIG. 41, 

the input interface of the PWB convert the differential 

HOLDITIN/: LOGIC HI input signals to TTL logic levels and resynchronize the 

10 addresses, strobes, and input data with the clock, as 

WRITEIN: LOGIC LO required by the memory module input timing require- 

ments. Write control, Y address, X address, and strobe 

WRCASIN/: LOGIC HI registers 406(a), (b), (c), and (</), are provided. 

PWB Output Interface Circuit — The output interface 

Circuit Operation— A memory cycle is initiated 13 circuit 401, FIG. 51, accepts data from the output 
when both YSTROBE/ and XSTROBE/ are at a registers of the five memory modules and 

LOGIC LO level when the clock goes LO. Signal MI outputs it to an external data bus 408. Operations 

goes HI, setting the NOR gate latch output LATCH/ wmch m required in order to output the data 

to a LOGIC LO. The X and Y addresses are latched by properly include converting TTL logic levels to 

a LOGIC LO from the LOAD/signal. The rising edge 20 differential logic levels, synchronizing the data 
of the next clock sets flip flop output DLS to a LOGIC with the data bus clock, and gating the data onto 

HI, initiating RAS/ and causing the delay line to begin _ ™™* at the P ro J*' tl f me ;, e . x 

propagating. After the LOGIC HI reaches the 30 nano- , M CcU Memory-^ C^Il Memory Section 325 a), 
second tap at the delay line, MUXIT/goes to a LOGIC <*>' » ^P 0 ^ of 30 <>" "Sf^/^ 20 PWB * 
LO and mulitplexes the Y address to the dynamic RAM 25 i^c. 5 PWBs for chrominance I 

address inputs. At the 60 nanosecond tap of the delay ™» «* chrominance Q data .tor- 

tine, CAS/ is initiated and signal LS goes LO. At the T ^P^mentation of the Cell Memory luminance and 
105 nanosecond tap of the delay line, signal RESET ^™T ce ***** ~£n b * K means 

goes HI, forcing MI to a LOGIC LO and resetting the 3Q 2fSfc3£^ 

xir^ri , i 4 v tu j t „ , , " 30 able between positions in the arrays, 

NOR gate lately The nsmg edge of the next clock sets Luminance ^ d Chrominance Arrays-The lumi- 

fhp Hop output DLS to a LOGIC LO which propagates nance chrominance of each Cell Memory 

down the delay line. In sequence, the address latches m fapfclIiaited by j nterconne c,i 0 „ of PWBs 

are released, RAX/ is terminated, signal LS goes HI to M explained below 

clock the RAM outputs into a register, and CAS b 35 ^ t wiring-The input signals to the Cell 

terminated. Finally. RESET goes to a LOGIC LO Met £ Action are formatted as differential logic 
permitting another memory cycle to be initiated PWBs for chrominance n ^ stora „ 

Implementation 

B^SSm^t: lth ^^T * rT^J^u of ™* for 10 board interconnections. Each pair 
REFRESHIN/ being a LOGIC LO, which inhibits the of signal |ines drives no more than 5 pwfi l t& & ch 

initiation of CAS/, the refresh mode-is identical m oper- «, pair of signa , !incs is tcrminated at ^ c PWB input most 

ation to the read mode. distant from ehe i ine ^ ri ving circuit with an impedance 

Module Output Data-The outputs of the module approximating the characteristic impedance of the line, 
shall consist of eight bits of output data during the read 

mode. No output data will be generated during the Input Signal Functions 

write and refresh modes. The data shall be represented 45 Address Buses— The seven-bit binary portion of the 

by TTL logic levels in positive true format. X and Y addresses must be provided to each PWB in 

Module Output Register-The module output data thc luminance and chrominance arrays. FIG. 42 shows 

shall be stored in a clocked register 398, FIO. 39, such ^ interconnection scheme for either the X or Y address 

that the register contents represent the results of the with each signal line connected to 5 PWBs. This circuit 

previous module read cycle until a register clock is 50 assumes drivers, 572(j), (6), (c) on the interface board 

generated by a subsequent read cycle. capable of driving two 120 ohm bus lines in parallel. It 

Alternate Write Mode Refresh— Referring to FIG. should be noted that the X and Y addresses experience 

50, nondestructive refresh may be accomplished by onc lcvel of inversion internal to the individual PWBs. 

executing Page Mode Write Cycles with the Wrcasin Luminance Data Buses— The eight bits of input data 

Command inhibited to a high logic level. The Holditin 55 to each module are distributed to the luminance PWBs 

Command may or may not be inhibited during refresh or memory modules 574 as shown in FIG. 43 in order to 

as convenient. implement the memory loading method to be used in 

Cell Memory PWB— The Cell Memory oprinted the Write Mode. WhUe straight daisy chaining is shown 
wiring board is the physical building block of the cell m FIG. 10 for clarity, the physical implementation pre- 
memory luminance and chrominance arrays. Each lumi- 60 mits dual parallel buses similar to those in FIG. 42. 
nance array includes twenty boards. Referring to FIG. Chrominance Data Buses— The chrominance data 
40, 36, each Cell Memory PWB contains five memory distribution is similar to that of the luminance. The 
modules and circuitry to control signal flow between signal routing scheme is shown in FIG. 44, wherein the 
the modules and the outside world. Functionally, this chrominance I Data interface 573 and chrominance Q 
circuitry consists of an input interface 400 and an output 65 data interface 574 input memory secions 575, 576, re- 
interface 401. spectively. 

PWB Module Selection— Each memory module Module Select Signals— The X and Y dimension 

402(c), (6), (c), (d), (e), on the wiring board PWB has module select strobes are routed through Y dimension 
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interface circuit 573 and X dimension interface circuit interval T 13 and until a new cycle is initiated, the 
576 per FIG 45 to implement the interleaved array strobes must be in the LOGIC HI state. Module select 
structure. The module select signals are derived frm the strobes, X address, Y address, write mode, write CAS 
BCD portion of the X and Y dimension addresses. are as shown. 

The control signals to the Cell Memory PWBs are in 5 SYSTEM PROCESSING 

differential format transmitted over twisted pair wire- . 
wrap wire or backplane etch. The remaining control The software processing requirements for the visual 
signals received by the modules are as follows: computer program are dictated by the need to provide 

Write Command— This signal determines whether flicker-free, minimally distorted images with adequate 
the Cell Memory Secion is in the write mode of opera- 10 resolution at the final display screens. The Visual Cora- 
tion or the read mode. It will change at a 30Hz rate. puter is provided geometric, environmental, flight pa- 
Refresh Command— This signal inhibits unnecessary rameter and instructor inputs from the simulator corn- 
internal operations in the Cell Memory during the re- puter 512 and Instructor Operator Station. The position 
fresh mode of operation. It has approximately a lKHz and attitude of the simulated vehicle at a tune when 
maximum pulse repetition rate. 15 image update will be required is predicted, and a scene 

Master Clear— This signal initializes the Cell Mem- transfer to the image displays is accomplished. The 
ory during initialization of the system. Visual Computer 19 operates with virtually no operator 

Holditin Signal— This signal is used in the write mode invention. Video Disks are manually loaded and 
to implement the Page Mode Write Cycles. It must be changed as required with directions appearing on the 
synchronized to the 14MHz write mode clock. 20 system console. 

Wrcasin Signal— This signal is used in the write mode The major sofware elements interface with the Ve- 
to generate memory timing required to implement the vice Interface Modules, Data Structure Modules, and 
Pale Mode Write Cycle: It mustbe synchronized to the Strategy Modules. These paragraphs provide the math 
14MHz write mode clock. models, algorithms and logic development required for 

Clock Input— Separate clock frequencies are re- 25 the Visual system programming, 
quired to implement the read mode and the write mode. The computation of the average times used in the 
Refresh mode may use either frequency. The two clock equation is made using counters and averaging tech- 
frequencies may be multiplexed on board each Cell niques, by compiling the number of frame times from 
Memory initiation to completion of each of the time variations 

Cell Memory Output Circuit— Referring to FIG. 51, 30 which most affect the prediction algorithm, 
the cell memory output circuit 401 serves to synchro- Using Adjacent Scene pointer data for the scene 
nize the outputs of the 20 cell memory PWB's in the selected, initiation parameters to begin scene transfer 
luminance array to a common clock multiplexing their from Video Disk to Scene memory are generated, corn- 
outputs into a common data stream corresponding to putation of the Scene Memory-to-Cell Memory transfer 
the sequence of addresses used to access the memory 35 parameters, predicted position, and attitude for times t p/ 
325(a) an output interface circuit 578 receives module and y are computed, then two sets of corner vectors for 
select strobes (or an encoded equivalent) during the the predicted window are computed. The ares bounded 
Read Mode. They are delayed by 8 clock periods (372 by these corner vectors are used to compute resolution, 
nanoseconds) to allow the RAM output data to settle at interpolator inputs, scene to cell transfer data, sweep 
the accessed memory module output register. The de- 40 delay numbers, etc. The parameters for scene to cell 
layed strobes would then be used to access the output transfer are computed and the predict task is termi- 
data from one of the modules in the array. The data is nated. In order to provide the displays with a correct 
then output to a common data bus. view, data in the scene borage system 28 * mapped mto 

Output Data Control Inputs— The Cell Memory the Cell Processor Systems 312(c), (*), (c), {d). The iCPb 
PWB data output circuit requires six control signals to 45 312 transforms the date into the display viewer's frame 
each PWB The output data control signals to imple- of reference. In order to load a Cell Processor 312 with 
ment the luminance array are shown in FIG. 46 and the required pixel density and field of view, it is ncces- 
those to implement the chrominance array are shown in sary to know the mapping of the viewing windows mto 
FIG 47 wherein clock 578 represents the chrominance the pseudo film plane. This section presents the method- 
output data interface circuit. 50 ology for the mapping of window into the pseudo film 
Input Signal Timing— Input signals which are plane. One underlying concept is to enclose a given 
clocked into registers in the Cell Memory PWB input window inside a rectangular projection raster and use 
-interface meet the-setup and hold times shown in.FIG. .the appropriate, window orientation angles with respect 
49 to the viewer's eyepoint coordinate system to identify 
Output Signals— The only output signals from the 55 the required window field of view. Using the appropri- 
Cell Memory PWBs are the eight bits of output data ate window geometries and other pertinent input data 
selected from one of the five modules during the read for an eyepoint, each corner of a window, Pl»r, is 
mode of operation. The output data buses of the lumi- mapped into the pseudo film plane, 
nance and chrominance arrays are shown in FIGS. A6 The equations providing the pseudo Rim coordinates 
and 60 for the window corners are solved for the first pre- 

Cell Memory Writelnput-Timing— FIG. 53-repre- -dieted use of-the data in a selected CPS memory-section. 

sents the cell memory input timing, wherein a write and the last predicted use (t F and t^ times respectively), 
clock time interval, line 579, corresponding to 14 peri- The required area to transfer is determined by finding 
ods of the write mode clock (14 316 MH* is required the minimum and maximum (XnuiN, YfmmI QLfmax, 
Time period) TO is shown initiating a memory cycle. 65 Yfmax) from these corner sets. This defines a rectangle 
During TO the module select strobes must be placed in which deletes the Scene Storage System tracks and 
their active, LO state. During interval T 1 through T 12 long-line interval to be transferred and the rectangular 
there is a "don't care" condition on the strobes. During area to be transferred to a cell memory section. The 
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record rasters paramenters associated with the scene Necessary detail from the photographic scenes is 
being processed provide the necessary data to compute derived by the flying spot scanner used to scan the 9" 
sweep delay number (SDN), starting line number, inter- film roll to provide a pixel resolution of approximately 
polator constants, etc, which are output to the hard- 4000 pixels in both horizontal and vertical directions, 
ware via the Computer Interface (CI). 5 Because of the size of the film and separation of the 
The part of the full scene which is deposited into the seven views, scanning is done in steps, and all of the 
cell memory is than read out at a 30 frame per second seven views are assembled in the pseudo-film plane 
rate by the cell Processor under control of the cell using the resolution-preserving mathematical transfor- 
processor read address generator. The distortion of the mation described, and as illustrated in FIG. 9. The 
image contained in the cell memory required to affect a 10 video in the primary colors of red (R), green (G) and 
video stream which, when displayed to an observer on blue (B) are digitized, and formatted such that each 
a rastering display device, will appear to be a correct terrain scene is made up of several NTSC frames (typi- 
view of the geometric system represented in the original cally 72). Compatibility with conventional TV record- 
pseudo film image, is produced by the action of the 3 X 3 ing apparatus results from the insertion of appropriate 
matrix operator of the Cell Processor system. The val- 15 sync signals which make the signals suitable for record- 
ues required are calculated by the visual computer and ing on standard video tape recorders and laser disks. To 
output to the Cell Processor, via the CI, at a 30 Hz rate. obtain faster access during playback, pieces of a corn- 
Having now considered the individual sections of the plete scene may be stored in multiple video tapes. Dur- 
circuit in detail, it will be helpful to review and summa* ing the record process, opportunity is afforded to ma- 
rize their interrelationship and operation in the overall 20 nipulate the luminance gain and color balance of each 
system, and to discuss the advantageous results which view in every scene so that the edges of the views ex- 
derive from the system. posed by all the seven lenses match up. Successive 
The process for determining the location from which scenes have their color and brightnes matched. The key 
the original photographs were made, and the attitude of to this processing is the luminance and color corrector 
the scanning platform at the time of exposure is in ac- 25 block together with the large, fast semiconductor mem- 
cord ance with photogrammetric techniques, as known ory (scene storage system 286SSS) which can store up 
in the art, and is used, for example, in aerial photogra- to 256 National Television System Commission (NTSC) 
phy resectioning. Data indentifying each photograph frames. 

relative to the geometric system photographed is pro- The eyepoint of every scene is determined by photo- 

duced, keyed to the scene locations on the video discs, 30 gammetric techniques which aid in the proper sequeno 

and stored in the digital data base accessable to the ing of the scanned scenes on the tape recorders. The 

computer 19. The scene prediction process, as dis- knowledge of accurate eyepoints also allows matching 

cussed, continuously selects the data segment appropri- one distorted scene to another when both scenes are 

ate for the next scene along the pack selected by the viewed from the same intermediate pilot position, 

operator. It will be recalled from the above description, 35 The video storage system 14 preferably employs an 

during the period in which motion is taking place using analog storage format using television techniques, as a 

a given fixed scene, the computer 19 is fetching a new practical and economical alternative to large capacity 

appropprate view from the fixed storage media to be digital storage, since it is designed to be especially 

used as an overlay substitute. The new view is selected suited to pictorial data. As previously stated, the targe 

by determining when the present scene must be dis- 40 capacity, video storage system, consisting of the sixteen 

carded in favor of a new scene. The trasformation pro- video disks, provides large segments of the desired data 

cess does not cause unrealistic distortions of the viewed under control of the host computer 19 in anticipation of 

scene. An important characteristic of the system is its the real time needs of the simulation. Any randomly 

capability to make one fixed scene serve in a dynamic accessed TV frame on a single play-back unit can be 

translation mode long enough to fetch another scene. A 45 located and made available in 2 to 8 seconds. Adjacent 
further major feature is the transformation process of or sequential frames (scenes) require much less time that 

the recording section whereby multiple views of a this, however. The players operate essentially indepen- 

given scene are integrated and processed from a data dently and are rotationally synchronized to the system 

segment corresponding to a single, psuedo image, hav- timing references for color subcarrier and horizontal 
ing a substantially spherical, or partly spherical field of 50 vertical raster scans. In operation, all these units do not 

view, in which the information derived from multiple supply data at the same time. Data is transferred from 

photographic views from diverging axes is contained. only a few (e.g. three) players at a time while the others 

The recording system 15' FIG. 4, may be termed a are searched for the anticipated subsequent scenes, 

first means for recording scenes comprising a plurality The Video Digitizer System (VDS) 195 is the func- 

of views taken on diverging axes, and second means for 55 tional unit which processes analog composite video 

integrating at least two of these views into a data seg- from the Video Storage System (VSS) 14 and sends 

ment corresponding to a single intergrated image de- digitized video to the scene storage system (SSS) 28. It 

void of geometric mapping discontinuities. will be recalled that the VDS has three identical chan- 

To provide for the (preferably) 360* of aximuth cov- nels since at any given time three video players can be 

erage and 100° of elevation (with high resolution 60 simultaneously accessed. The quasi-NTSC video from 

throughout), the camera incorporating multiple lenses the VSS is read, time base corrected, clamped and digi- 

with associated mirrors is employed for providing high tized in the VDS. Composite video to component video 

resolution color transparencies. The gaming area is conversion and spatial compression of the digitized 

partitioned to contain a large number of "eyepoints 1 video are carried out by the luminance and chrotni* 

distributed in several altitudes in straight and/or cross 65 nance processors to remove the NTSC sync format and 

tracks. The photography density varies inversely with to take advantage of the redundancy present in the I and 

altitude to provide the required coverage for smooth Q components of the color signal and to save memory 

transition from scene to scene. storage space in the SSS 28. The VDS 195 also provides 
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the interface between the visual system computer 19 
and the rest of the visual system hardware. 

The scene storage system 28, as has been discussed, 
comprises two identical sections of up to 128 tracks 
each. Each track has the capacity to store digital video 
information including color, present in one NTSC line 
TV frame (1/30 sec.). Video information is written to 
one section while it is read form the second section. 
When fresh data is required, the input side becomes the 
output side and vice versa. Three channels of data can 
be input to the SSS 28, and the SSS in turn can provide 
multiplexed Y, I & Q digital data to the 4-cell processor 
systems 312(a), (6), (c), (</) simultaneously. 

The cell processor system 312 receives the digital 
luminance and chrominance data corresponding to a 
scene from the SSS 28. Under software control it selects 
the portion which is visible to the pilot through one 
window, performs the geometric transformation on this 
data as required by motion of the pilot's eyepoint, and 
generates analog trichromatic (e.g. red, green and blue) 20 
video signals for display. Data is received from the SSS 
286 by four input interpolators, 324(a), (6), (c), (d) (FIG. 
23) which operate independently and simultaneously. 
Each of the interpolators channels the Y, I & Q into 
separate data streams, performs low-pass-filtering, and 25 
interpolates or decimates as required to provide data at 
the proper rate to be loaded into the cell memory. Fil- 
tering and interpolation are done in both longitudinal 
and transverse directions, and the parameter controlling 
these operations is supplied by the visual computer. 

The Cell Memory consists of two sections 325(a), 
325(6), FIG. 23. One section may be read for display 
while the other is being loaded by the interpolatore. An 
output multiplexer 327 selects the data from the appro- 
priate section and provides it to the output processor. 
The addresses for the Cell Memory are provided by the 
Address Generator 330. The read addresses are ob- 
tained from the display-raster pixel coordinates by a 
transformation corresponding to a piecewise continu- 
ous rotation, skew, and magnification in order to create 40 
a display of the scene data as seen from the pilot's eye- 
point. 

The output processor 333, 334, 335, 336 receives data 
through the memory multiplexer 327, performs low 
pass filtering, simulates haze, and inserts sky indication 45 
above the horizon. It also provides for replacement of a 
limited number of pixels in the output scene with pixels 
supplied by the Visual Computer 19 and, optionally, for 
insertion of a light point surrounded by a black square 
for the automatic position error sensing system. Finally 50 
the trichromatic digital data streams are converted to 
analog signals, filtered and provided to the display 
along with a sync signal. 

Partially because of the use of the high resolution, 
photographic data base, the system thus provides major 55 
advantages over existing visual simulator systems. 
Some of these advantages are its ability to provide 
scene-realism, detail, 3-dimensionality, and texture that 
is limited only by photography and virtually unlimited 
for expandability of data base. The real-time playback 60 
system provides the operator with a continuous display 
of the gaming area as presented on a hemispherical rear 
screen projection system. The scope of the gaming area 
is large enough and flexible enough for a simulator pilot 
to fly a mission with total maneuvering freedom. The 
use of progressively smaller but faster memory systems 
[video discs 14, scene storage system 28, cell processor 
memories 325(a), (b)] permits real-time processing of 
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the image as required to simulate rapid movement 
through the "gaming area" or geometric system while 
retaining appropriate image detail for assuring realistic 
' pictorial simulation. Because of the description of the 
displayed image from a data segment corresponding to, 
and capable of reproducing a single, partially or wholly 
spherical field of view (not necessarily duplicating the 
original views) mapping and overlap disparaties be- 
tween divergent views are eliminated. The output data 
segments do not necessarily duplicate the photographic 
views, and may appear as taken from different eye point 
positions. Additionally the very high memory capacity 
provided by the cell processors memory system 325, 
with its interleaved "line sequenced sampling", pro- 
vides the massive processing capacity needed for the 
image processing techniques entailed in such real time 
image transformations. 

While only one embodiment of the invention, to- 
gether with modification thereof, has been described in 
detail herein and shown in the accompanying drawing, 
it will be evident that various further modifications are 
possible in the arrangement and construction of its com- 
ponents without departing from the scope of the inven- 
tion: 

What is claimed is: 

1. A relatively high speed memory system comprised 
of relatively slow speed electronic memory means, said 
memory system organized as a planar array of rows and 
columns of word positions and comprising: 

(a) address generator means for generating sequences 
of N addresses to access sequences of N words of 
data along selected substantially straight paths m 
any direction across said memory array with each 
address generated having a set of most significant 
bits and a set of least significant bits; 

(b) a plurality of electronic memory means, each of 
said memory means having address decoder means 
responsive to a plurality of address bits for select- 
ing a memory element within said memory means 
and enable means responsive to an enable signal for 
enabling said memory means; and 

(c) logic means coupling said address generator 
means to said electronic memory means, said set of 
least significant bits being selectively coupled to 
the enable means of said memory means for selec- 
tively enabling at least one of said memory means 
and said most significant bits being selectively cou- 
pled to said address decoder means for addressing 
a selected memory element within said enabled 
memory means; wherein 

(d) N is greater than one and wherein no memory 
means is selected more than once per sequence of 
N memory accesses. 

2. The memory system of claim 1 wherein each mem- 
ory element stores a single bit and wherein said selector 
means selectively simultaneously enables m of said 
memory means during each memory access to thereby 
access m-bits which form an m-bit word. 

3. The memory system of claim 1 wherein said mem- 
ory means are integrated circuit random access memory 
chips. 

4. The memory system of claim 3 wherein said enable 
means is the chip select means of said integrated circuit 
random access memory chip. 

5. The memory system according to claim 4 wherein 
said memory chips are I by n-bit 

6. The memory system according to claim 5 wherein 
said memory chips are 16K memory chips. 
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7. The memory system of claim 1 wherein each mem- 
ory element stores an m-bit word. 

8. The memory system of claim 1 wherein said mem- 
ory system is operable at approximately N times the 
maximum operating time of said individual electronic 5 
memory means. 

9. A relatively high speed memory system comprised 
of relatively slow speed electronic memory means, said 
memory system organized as a planar array of rows and 1Q 
columns of word positions and comprising: 

(a) address generator means for generating sequences 
of N addresses to access sequencies of N words of 
data along any selected substantially straight paths 

in any direction across said memory array with 15 
each address generated having a set of most signifi- 
cant bits and a set of least significant bits; 

(b) a plurality of electronic memory means, each of 
said memory means having address decoder means 
responsive to a plurality of address bits for select- 20 
ing a memory element within said memory means 
and enable means responsive to an enable signal for 
enabling said memory means; and 

(c) logic means coupling said address generator 
means to said electronic memory means, said logic 23 
means including: 

(i) first means responsible to each address gener- 
ated by said address generator means for selec- 
tively enabling at least one of said memory 
means during each memory access with N being 
greater than one and no memory means being 
selected more than once per sequence of N mem- 
ory accesses; and 

(ii) second means responsive to each address gener- 35 
ated by said address generator means for ad- 
dressing a selected memory element within said 
enabled memory means. 

10. The memory system of claim 9 wherein each 
memory element stores a single bit and wherein said 40 
selector means selectively simultaneously enables m of 
said memory means during each memory access to 
thereby access m-bits which form an m-bit word. 

11. The memory system according to claim 9 wherein 
said set of least significant bits is coupled to said first 45 
means for generating said enable signal and said most 
significant bits are coupled to said second means for 
addressing said least significant bits of said enabled 
memory means. 

12. The memory system of claim 9 wherein said mem- 50 
ory means are integrated circuit random access memory 
chips. 

13. The memory system of claim 12 wherein said 
enable means is the chip select means of said integrated 55 
circuit random access memory chip. 

14. The memory system according to claim 13 
wherein said memory chips are 1 by n-bit. 

15. The memory system according to claim 14 
wherein said memory chips are 16K memory chips. 60 

16. The memory system of claim 9 wherein each 
memory element stores an m-bit word. 
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17. The memory system according to claim 9 wherein 
said system is operable at a speed approximately N times 
the maximum operating speed of said memory means. 

18. A relatively high speed memory system com- 
prised of relatively slow speed electronic memory 
means, said memory system organized as a planar array 
of rows and columns of memory modules with each 
memory module organized as a planar array of rows 
and columns of word positions and comprising: 

(a) address generator means for generating sequences 
of N addresses to access sequences of N words of 
data along selected substantially straight paths in 
any direction across said arrays with each address 
generated having a set of most significant bits and a 
set of least significant bits; 

(b) a plurality of electronic memory means, each of 
said memory means having address decoder means 
responsive to a plurality of address bits for select- 
ing a memory element within said memory means 
and enable means responsive to an enable signal for 
enabling said memory means; and 

(c) logic means coupling said address generator 
means to said electronic memory means, said set of 
least significant bits being selectively coupled to 
the enable means of said memory means for selec- 
tively enabling one of said memory means and said 
most significant bits being selectively coupled to 
said address decoder means for addressing a se- 
lected memory element within said enabled mem- 
ory means; wherein 

(d) each of the memory elements of any given mem- 
ory means is assigned to a row and column position 
in a different respective memory" module, and 
wherein N is greater than one and wherein no 
memory means is selected more than once per 
sequence of N memory accesses. 

19. The memory system of claim 18 wherein each 
memory element stores a single bit and wherein m 
planes of said planar arrays of memory modules, are 
provided, said logic means selectively simultaneously 
enabling one of said memory means on each of said m 
planes during each memory access to thereby simulta- 
neously access m bits which form an m-bit word. 

20. The memory system according to claim 18 
wherein said memory means are 1 by n-bit integrated 
circuit random access memory chips. 

21. The memory system according to claim 20 
wherein said memory chips are 16K bit memory chips. 

22. The memory system according to claim 20 
wherein said memory system is organized as a planar 
array of P rows and R columns of memory modules 
where P and R are integers greater than one and the 
product of P and R is equal to n. 

23. The memory system according to claim 22 
wherein said memory modules are organized as planar 
arrays of p rows and r columns of word positions where 
p and r are integers greater than one and the product of 
p and r is equal to the number of memory means com- 
prising a plane of planar modules of the memory system. 

24. The memory system according to claim 23 
wherein p and r are each equal to N. 

* • * * • 



65 



08/26/2003, EAST Version: 1.04.0000 



